CN103106054B - System and method for improving interactive content browsing service through graphics processor - Google Patents
System and method for improving interactive content browsing service through graphics processor Download PDFInfo
- Publication number
- CN103106054B CN103106054B CN201110352873.5A CN201110352873A CN103106054B CN 103106054 B CN103106054 B CN 103106054B CN 201110352873 A CN201110352873 A CN 201110352873A CN 103106054 B CN103106054 B CN 103106054B
- Authority
- CN
- China
- Prior art keywords
- content
- client
- icb
- original image
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 42
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 57
- 230000002708 enhancing effect Effects 0.000 claims abstract description 18
- 230000006870 function Effects 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 4
- 238000012800 visualization Methods 0.000 claims description 3
- 230000007704 transition Effects 0.000 claims 1
- 238000005265 energy consumption Methods 0.000 abstract description 6
- 230000001965 increasing effect Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 6
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- HPTJABJPZMULFH-UHFFFAOYSA-N 12-[(Cyclohexylcarbamoyl)amino]dodecanoic acid Chemical compound OC(=O)CCCCCCCCCCCNC(=O)NC1CCCCC1 HPTJABJPZMULFH-UHFFFAOYSA-N 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
本发明公开一种以图形处理器提升可互动内容浏览服务的系统与方法,通过绘图卡中的图形处理器的运算能力来协助进行原需由中央处理器来执行的运算工作,使得由执行于服务器上的浏览器应用程序所绘制的多个原图可被图形处理器内的编码器直接自绘图卡内的显示卡载存储器中取出并编码串流后,即直接传送给位于远端的用户端。因此,可大幅降低中央处理器的工作负荷以及总线频宽的使用量,进而相对增加单一服务器所能同时提供服务的用户端数量、也相对地减少了能源的消耗。
The present invention discloses a system and method for enhancing interactive content browsing service with a graphics processor. The computing power of the graphics processor in the graphics card is used to assist the computing work originally performed by the central processing unit. The multiple original pictures drawn by the browser application on the server can be directly taken out by the encoder in the graphics processor from the display card on-board memory in the graphics card, encoded and streamed, and then sent directly to the remote user end. Therefore, the workload of the central processing unit and the usage of the bus bandwidth can be greatly reduced, thereby relatively increasing the number of clients that a single server can provide services at the same time, and relatively reducing energy consumption.
Description
技术领域technical field
本发明为一种以图形处理器提升可互动内容浏览服务的系统与方法,尤指一种通过图形处理器直接读取、编码与串流显示卡载存储器内的原图,来避免占用中央处理器运作频宽的一种以图形处理器提升可互动内容浏览服务的系统与方法。The present invention is a system and method for enhancing interactive content browsing service with a graphics processor, especially a graphics processor that directly reads, encodes, and streams the original image in the on-card memory to avoid occupying the central processing A system and method for enhancing interactive content browsing service with graphics processing unit operating bandwidth.
背景技术Background technique
在现今的云端服务系统例如但不局限于云端网络浏览服务系统或是云端网络应用服务系统中,其服务器的典型功能是用来提供以网页形式或其他形式显示的内容给位于远端的一或多个用户端。当这被提供的内容中包含影像(Video)时,这些影像的原图(RawImages)必须先在服务器端被编码成串流形式的数据后,才能传输给用户端并以网页形式或其他形式在用户端的浏览器或影像视窗上显示。然而,若是在同一时间内有许多用户端想自单一云端服务系统中读取各种包含影像的内容时,则对于影像原图的编码工作以及将编码串流传送于图形处理器(GPU)与中央处理器(CPU)之间的操作,将会大量占用原可被应用程序使用的系统资源与中央处理器的工作频宽,进而限制了该云端服务系统可同时连线(也就是云端服务系统可提供服务)的用户端的数量与系统的运作效能。另一方面,对于具有相同服务容量的不同云端服务系统来说,其能量消耗多寡也是一重要议题。In today's cloud service systems such as but not limited to cloud web browsing service systems or cloud web application service systems, the typical function of the server is to provide content displayed in the form of web pages or other forms to a remote one or Multiple clients. When the provided content contains images (Video), the original images (RawImages) of these images must first be encoded into streaming data on the server side before being transmitted to the client and displayed in the form of web pages or other forms. displayed on the browser or image window of the client. However, if many clients want to read various content including images from a single cloud service system at the same time, the encoding work of the original image and the encoding stream transmission between the graphics processing unit (GPU) and The operations between the central processing units (CPUs) will occupy a large amount of system resources that can be used by applications and the operating bandwidth of the central processing unit, thereby limiting the simultaneous connection of the cloud service system (that is, the cloud service system The number of clients that can provide services) and the operating performance of the system. On the other hand, for different cloud service systems with the same service capacity, the amount of energy consumption is also an important issue.
请参阅图1所示,为现有云端服务系统1的第一种例子。该云端服务系统1是通过如下操作来提供一数据库中心的云端网络应用与浏览服务:Please refer to FIG. 1 , which is the first example of the existing cloud service system 1 . The cloud service system 1 provides a database center cloud network application and browsing service through the following operations:
1.显示111:由云端服务系统1的服务器11端所执行的浏览器应用程序经由作业系统(Operating System;简称OS)的应用程序介面(Application Programming Interface;简称API)来绘制可供显示于显示周边(Display Peripheral)上的多个原图内容;1. Display 111: the browser application program executed by the server 11 of the cloud service system 1 can be displayed on the display through the application programming interface (Application Programming Interface; API) of the operating system (Operating System; OS for short) Multiple original image contents on the Display Peripheral;
2.编码112:自该显示周边读取该些原图并传送给一硬件或软件编码器进行编码串流;2. Encoding 112: read the original images from the periphery of the display and send them to a hardware or software encoder for encoding and streaming;
3.串流113:自该编码器读取该串流并经由一网络设备14传送给位于远端的用户端91。3. Stream 113 : read the stream from the encoder and send it to the remote client 91 via a network device 14 .
在如图1所示的此种现有技术中,云端服务系统1的各服务器11、12、13端所执行的浏览器应用程序经由作业系统内的每一服务器11、12、13在同一时间仅能提供服务给单一个用户端91、92、93。如欲提高云端服务系统1的服务能量,则必须增加云端服务系统1中的服务器11、12、13数量而导致成本的大幅提高,并非经济的解决方案。In this prior art shown in Figure 1, the browser applications executed by the servers 11, 12, and 13 of the cloud service system 1 are executed at the same time via each server 11, 12, and 13 in the operating system. Services can only be provided to a single client 91, 92, 93. If the service capacity of the cloud service system 1 is to be increased, the number of servers 11 , 12 , 13 in the cloud service system 1 must be increased, resulting in a significant increase in cost, which is not an economical solution.
请参阅图2所示,为现有云端服务系统2的第二种例子。该云端服务系统2是通过如下操作来提供一数据库中心的云端网络应用与浏览服务:Please refer to FIG. 2 , which is the second example of the existing cloud service system 2 . The cloud service system 2 provides a database center cloud network application and browsing service through the following operations:
1.程序211:云端服务系统2内的一服务器21中可执行有多个应用程序211、212,每一个应用程序211、212分别构成一应用程序执行环境以供位于远端的一用户端91、92可以通过网络设备24来连线并使用服务器21(云端服务系统2)所提供的服务;1. Program 211: multiple application programs 211, 212 can be executed in a server 21 in the cloud service system 2, and each application program 211, 212 respectively constitutes an application program execution environment for a remote client 91 , 92 can be connected through the network device 24 and use the services provided by the server 21 (cloud service system 2);
2.存储器2111:由云端服务系统2的服务器21端所执行的浏览器应用程序经由作业系统的应用程序介面来绘制可供显示于显示周边上的多个原图内容,并将这些原图储存于受作业系统控制的服务器21的系统存储器2111内;2. Storage 2111: the browser application program executed by the server 21 of the cloud service system 2 draws a plurality of original image contents that can be displayed on the display periphery through the application program interface of the operating system, and stores these original images In the system memory 2111 of the server 21 controlled by the operating system;
3.编码2112:自作业系统层控制下的该系统存储器2111中读取该些原图并传送给一硬件或软件编码器进行编码串流;3. Encoding 2112: read the original images from the system memory 2111 under the control of the operating system layer and send them to a hardware or software encoder for encoding and streaming;
4.串流2113:自该编码器读取该串流并经由网络设备24传送给位于远端的相对应的用户端91。4. Stream 2113 : read the stream from the encoder and send it to the corresponding client 91 at the far end via the network device 24 .
在如图2所示的此种现有技术中,云端服务系统2的每一服务器21、22将得以同时提供服务给数个用户端91、92、93。然而,由于其将原图储存于系统存储器2111、以及原图的编码操作必须使用到服务器的中央处理器(CPU)的工作能量,且其原图数据在系统存储器2111与显示卡载存储器(Video RAM;简称VRAM)之间的传输过程也会占用许多总线频宽(Bus Bandwidth),进而对于服务器21、22的运作造成相当大的负担,不仅因而限制了单一服务器所能同时提供服务的用户端数量、也相对地消耗了较多的能源,而有进一步改善的空间。In the prior art shown in FIG. 2 , each server 21 , 22 of the cloud service system 2 can provide services to several clients 91 , 92 , 93 at the same time. However, because it stores the original image in the system memory 2111 and the encoding operation of the original image must use the working energy of the central processing unit (CPU) of the server, and its original image data is stored in the system memory 2111 and the display card memory (Video RAM (referred to as VRAM) will also take up a lot of bus bandwidth (Bus Bandwidth), and then cause a considerable burden on the operation of the servers 21, 22, which not only limits the number of clients that a single server can provide services at the same time Quantity also relatively consumes more energy, and there is room for further improvement.
发明内容Contents of the invention
本发明的主要目的是在于提供一种以图形处理器提升可互动内容浏览服务的系统与方法,其不仅可以增加单一服务器可同时提供服务的用户端的数量,同时亦有耗能相对较低的优点。The main purpose of the present invention is to provide a system and method for using a graphics processor to enhance interactive content browsing services, which can not only increase the number of clients that a single server can provide services at the same time, but also have the advantage of relatively low energy consumption .
为达上述的目的,本发明提供一种以图形处理器提升可互动内容浏览服务的系统与方法,其通过绘图卡中的图形处理器的运算能力来协助进行原需由中央处理器来执行的运算工作,使得由执行于服务器上的浏览器应用程序所绘制的多个原图可被图形处理器内的编码器直接自绘图卡内的显示卡载存储器中取出并编码串流后,即直接传送给位于远端的用户端。因此,可大幅降低中央处理器的工作负荷以及总线频宽的使用量,进而相对增加单一服务器所能同时提供服务的用户端数量、也相对地减少了能源的消耗。In order to achieve the above-mentioned purpose, the present invention provides a system and method for using a graphics processor to enhance interactive content browsing services, which uses the computing power of the graphics processor in the graphics card to assist in performing tasks that would otherwise be performed by the central processing unit. Computing work, so that multiple original images drawn by the browser application program executed on the server can be directly taken out by the encoder in the graphics processor from the display card on-board memory in the graphics card and encoded as a stream, that is, directly sent to the remote client. Therefore, the workload of the central processing unit and the usage of the bus bandwidth can be greatly reduced, thereby relatively increasing the number of clients that a single server can provide services at the same time, and relatively reducing energy consumption.
于一较佳实施例中,本发明的以图形处理器提升可互动内容浏览服务系统包括有至少一网络设备以及至少一服务器,其可供至少一用户端通过一网络环境进行连线并读取一内容。该至少一网络设备是用来连线于该网络环境。该至少一服务器系连接于该至少一网络设备,该至少一网络设备可供该至少一用户端通过该网络环境与该至少一服务器建立连线。其中,各服务器分别包括有:In a preferred embodiment, the interactive content browsing service system enhanced by a graphics processor of the present invention includes at least one network device and at least one server, which can be connected and read by at least one client through a network environment one content. The at least one network device is used to connect to the network environment. The at least one server is connected to the at least one network device, and the at least one network device allows the at least one client to establish a connection with the at least one server through the network environment. Among them, each server includes:
一中央处理器模块,其包括有至少一中央处理器(CPU)且执行有一作业系统(OS),且在该作业系统下执行有至少一应用程序(Application);其中,所执行的各个该至少一应用程序分别构成一应用程序执行环境(App Runtime environment)供其中之一该用户端所连线及使用,使已连线的该用户端可以通过该应用程序执行环境提出一读取要求;以及A central processing unit module, which includes at least one central processing unit (CPU) and executes an operating system (OS), and at least one application program (Application) is executed under the operating system; wherein, each of the executed at least An application program constitutes an application program execution environment (App Runtime environment) for one of the client terminals to connect and use, so that the connected client terminal can submit a read request through the application program execution environment; and
至少一绘图卡,各个该至少一绘图卡分别包括有一显示卡载存储器(VRAM)以及至少一图形处理编码器(GPU based encoder);其中,各个该应用程序执行环境系分别对应于其中之一该图形处理编码器,且该应用程序执行环境至少产生一原图(Raw image)储存于该显示卡载存储器中,并且,依据该已连线的用户端的该读取要求,对应的该图形处理编码器系自该显示卡载存储器取出对应的该原图并加以编码串流后传送给该用户端。At least one graphics card, each of the at least one graphics card includes a display card on-board memory (VRAM) and at least one graphics processing encoder (GPU based encoder); wherein, each of the application program execution environments corresponds to one of the Graphics processing coder, and the application execution environment at least generates a raw image (Raw image) stored in the display card memory, and, according to the read request of the connected client, corresponding to the graphics processing code The device fetches the corresponding original image from the on-board memory of the display card, encodes it and streams it, and transmits it to the client.
于本发明的一实施例中,该读取要求是已连线的该用户端欲将由该应用程序执行环境所产生的该原图显示于已连线的该用户端以供浏览的要求,且该应用程序执行环境会根据该读取要求而提出一应用程序介面(API)转向事件,使该对应的该图形处理编码器依据该应用程序介面(API)转向事件来自该显示卡载存储器取出对应的该原图并加以编码串流后传送给该用户端,而不需经由该中央处理器来对该原图进行编码串流运算。In an embodiment of the present invention, the read request is a request that the connected client wants to display the original image generated by the application program execution environment on the connected client for browsing, and The application program execution environment will propose an application program interface (API) turn event according to the read request, so that the corresponding graphics processing coder can fetch the corresponding image from the display card memory according to the application program interface (API) turn event. The original image is coded and streamed and then sent to the client without the CPU performing encoding and streaming operations on the original image.
于本发明的一实施例中,该内容是一可互动内容浏览服务(Interact-ableContent Browsing Service;简称I CB)的内容,且可以一网页(webpage)的形式显示于该用户端上,且于该网页中包括有该原图。In one embodiment of the present invention, the content is the content of an interactive content browsing service (Interact-ableContent Browsing Service; ICB for short), and can be displayed on the client in the form of a webpage (webpage), and in This web page includes the original image.
于本发明的一实施例中,该作业系统可以是下列其中之一:Windows XP、WindowsVista、Windows 7。In an embodiment of the present invention, the operating system may be one of the following: Windows XP, Windows Vista, Windows 7.
于本发明的一实施例中,该网络环境可以是下列其中之一:互联网络(Internet)环境、电话通讯网络环境、有线电视网络环境。In an embodiment of the present invention, the network environment may be one of the following: an Internet network (Internet) environment, a telephone communication network environment, and a cable television network environment.
于本发明的一实施例中,该用户端可以是具网络连结功能的下列其中之一:电脑、个人数字助理(PDA)、手机、游戏机、电视机上盒。In an embodiment of the present invention, the client terminal may be one of the following devices with network connection function: computer, personal digital assistant (PDA), mobile phone, game console, and TV set-top box.
附图说明Description of drawings
图1为现有云端服务系统的第一种例子示意图;FIG. 1 is a schematic diagram of a first example of an existing cloud service system;
图2为现有云端服务系统的第二种例子示意图;FIG. 2 is a schematic diagram of a second example of an existing cloud service system;
图3为说明本发明以图形处理器提升可互动内容浏览服务的系统一实施例的架构图;FIG. 3 is a structure diagram illustrating an embodiment of a system for enhancing interactive content browsing services with a graphics processor according to the present invention;
图4为本发明以图形处理器提升可互动内容浏览服务的系统中的一服务器实施例的示意图;FIG. 4 is a schematic diagram of a server embodiment in a system for enhancing interactive content browsing services with a graphics processor according to the present invention;
图5为说明本发明在可互动内容浏览服务(ICB)执行环境下的服务器端操作的一实施例流程图;FIG. 5 is a flowchart illustrating an embodiment of the server-side operation of the present invention in an interactive content browsing service (ICB) execution environment;
图6为说明本发明以图形处理器提升可互动内容浏览服务方法于系统端的一实施例流程图;FIG. 6 is a flow chart illustrating an embodiment of the method of using a graphics processor to enhance interactive content browsing service on the system side of the present invention;
图7为说明本发明以图形处理器提升可互动内容浏览服务方法于用户端操作的一实施例流程图;7 is a flow chart illustrating an embodiment of the present invention using a graphics processor to enhance the interactive content browsing service method to operate on the client side;
图8为说明本发明以图形处理器提升可互动内容浏览服务方法于用户端播放程序的一实施例流程图。FIG. 8 is a flow chart illustrating an embodiment of the present invention using a graphics processor to enhance interactive content browsing service method to play programs on the client side.
附图标记说明:1、2~现有云端服务系统;11、12、13、21、22~服务器;111~显示;112、2112~编码;113、2113~串流;14、24~网络设备;211、212~程序;2111~系统存储器;3~本发明以图形处理器提升可互动内容浏览服务系统;31、32、4~服务器;311、312、4121~程序;3111~显示卡载存储器;3112~编码;3113~串流;34~网络设备;35~图形处理编码器;41~中央处理器模块;411~作业系统;412、413~应用程序执行环境;4122~提出API转向;42~绘图卡;421~显示卡载存储器;4211、4212~原图;422、423、424~图形处理编码器;90~网络环境;91、92、93~用户端。Explanation of reference signs: 1, 2~existing cloud service system; 11, 12, 13, 21, 22~server; 111~display; 112, 2112~coding; 113, 2113~streaming; 14, 24~network equipment ; 211, 212 ~ program; 2111 ~ system memory; 3 ~ the present invention uses a graphics processor to enhance the interactive content browsing service system; 31, 32, 4 ~ server; 311, 312, 4121 ~ program; 3111 ~ display card memory ; 3112~coding; 3113~streaming; 34~network equipment; 35~graphic processing encoder; 41~central processing unit module; 411~operating system; 412, 413~application program execution environment; ~drawing card; 421~display card memory; 4211, 4212~original image; 422, 423, 424~graphic processing encoder; 90~network environment; 91, 92, 93~user terminal.
具体实施方式detailed description
本发明所揭露的以图形处理器提升可互动内容浏览服务的系统与方法,主要是通过绘图卡中的图形处理器的运算能力来协助进行原需由中央处理器来执行的运算工作,使得由执行于服务器上的浏览器应用程序所绘制的多个原图可被图形处理器内的编码器直接自绘图卡内的显示卡载存储器中取出并编码串流后,即直接传送给位于远端的用户端。因此,可大幅降低中央处理器的工作负荷以及总线频宽的使用量,进而相对增加单一服务器所能同时提供服务的用户端数量、也相对地减少了能源的消耗。The system and method for enhancing the interactive content browsing service with a graphics processor disclosed in the present invention mainly uses the computing power of the graphics processor in the graphics card to assist in the calculation work that should be performed by the central processing unit. The multiple original images drawn by the browser application program running on the server can be directly taken out by the encoder in the graphics processor from the on-board memory of the graphics card and encoded as a stream, and then directly sent to the remote client side. Therefore, the workload of the central processing unit and the usage of the bus bandwidth can be greatly reduced, thereby relatively increasing the number of clients that a single server can provide services at the same time, and relatively reducing energy consumption.
为了能更清楚地描述本发明所提出的以图形处理器提升可互动内容浏览服务的系统与方法,以下将配合图式详细说明的。In order to more clearly describe the system and method for enhancing the interactive content browsing service with a graphics processor proposed by the present invention, the following will be described in detail with reference to the drawings.
请参阅图3与图4所示,其中,图3为说明本发明以图形处理器提升可互动内容浏览服务的系统一实施例的架构图,且图4为本发明以图形处理器提升可互动内容浏览服务的系统中的一服务器实施例的示意图。Please refer to FIG. 3 and FIG. 4, wherein, FIG. 3 is a structure diagram illustrating an embodiment of a system for enhancing interactive content browsing services using a graphics processor in the present invention, and FIG. 4 is a graphic processor in the present invention to enhance interactive content. A schematic diagram of a server embodiment in the content browsing service system.
如图3所示,本发明以图形处理器提升可互动内容浏览服务的系统3,其可供至少一用户端91、92、93通过一网络环境90与该系统3进行连线并使用由该系统3所提供的服务,例如但不局限于:自该系统3读取一内容并显示于用户端91、92、93的显示器上。其中,该网络环境90可以是下列其中之一:互联网络(Internet)环境、有线电视网络环境、或是电话通讯网络环境例如但不局限于全球行动通讯网络(Global System for MobileCommunications;简称GSM)、整合封包无线电服务网络(General Packet Radio Service;简称GPRS)、分码多工读取网络(Code Division Multiple Access;简称CDMA)等。而该用户端91、92、93则泛指提供一般使用者连结至该些网络环境90所使用的电子资讯装置,例如但不局限于具互联网络、电话通讯网络或是有线电视网络连结功能的下列其中之一:电脑、个人数字助理(PDA)、手机、游戏机、或是电视机上盒等。As shown in FIG. 3 , the present invention uses a graphics processor to enhance a system 3 for interactive content browsing services, which can be used by at least one client 91, 92, 93 to connect to the system 3 through a network environment 90 and use the The services provided by the system 3 are, for example but not limited to: reading a content from the system 3 and displaying it on the monitors of the client terminals 91 , 92 , 93 . Wherein, the network environment 90 may be one of the following: Internet (Internet) environment, cable television network environment, or telephone communication network environment such as but not limited to Global System for Mobile Communications (Global System for Mobile Communications; GSM for short), Integrated packet radio service network (General Packet Radio Service; GPRS for short), code division multiple access reading network (Code Division Multiple Access; CDMA for short), etc. The client terminals 91, 92, and 93 generally refer to electronic information devices used by general users to connect to these network environments 90, such as but not limited to those with Internet, telephone communication network or cable TV network connection functions. One of the following: computer, personal digital assistant (PDA), mobile phone, game console, or TV set-top box, etc.
于本发明的一实施例中,该以图形处理器提升可互动内容浏览服务的系统3包括有:至少一网络设备34、以及至少一服务器31、32(以多个服务器为佳)。该至少一网络设备34可用以连线于该网络环境90,并让位于远端的至少一用户端91、92、93(通常为多个用户端)通过该网络环境90而与该些服务器31、32建立连线,进而使用由本发明系统3中的服务器31、32所提供的云端服务。本发明的以图形处理器提升可互动内容浏览服务系统3中的各个服务器31、32,是通过如下操作来提供一数据库中心的云端网络应用与浏览服务给各个用户端91、92、93使用:In an embodiment of the present invention, the system 3 for enhancing interactive content browsing services by using a graphics processor includes: at least one network device 34, and at least one server 31, 32 (multiple servers are preferred). The at least one network device 34 can be used to connect to the network environment 90, and allow at least one client terminal 91, 92, 93 (usually a plurality of client terminals) at the remote end to communicate with the servers through the network environment 90 31, 32 establish a connection, and then use the cloud service provided by the servers 31, 32 in the system 3 of the present invention. In the present invention, each server 31, 32 in the interactive content browsing service system 3 is enhanced by a graphics processor, and a cloud network application and browsing service of a database center is provided to each client 91, 92, 93 through the following operations:
1.程序311、312:于各个服务器31中分别可执行有多个应用程序311、312(例如但不局限于:浏览器应用程序),每一个应用程序311、312分别构成一应用程序执行环境(Application Runtime Environment)以供位于远端的一用户端91、92可以通过网络设备34来连线并同时使用同一服务器31所提供的服务(例如但不局限于:网页内容下载与浏览服务);1. Programs 311, 312: Multiple application programs 311, 312 (such as but not limited to: browser application programs) can be executed in each server 31, and each application program 311, 312 respectively constitutes an application program execution environment (Application Runtime Environment) for a remote client terminal 91, 92 to connect through the network device 34 and simultaneously use the services provided by the same server 31 (such as but not limited to: web content download and browsing services);
2.显示卡载存储器(VRAM)3111:由各应用程序311的执行所构成的各个应用程序执行环境来绘制可供显示于显示周边上的视觉化的一系列原图内容,并将这些原图储存于绘图卡(Graphic Card)上的显示卡载存储器3111内;其中,第一个该原图的每一个元件都会被写入显示卡载存储器3111中,而其后的各个该原图只有与前一个该原图不同的部分才会被写入该显示卡载存储器3111中以更新其内所储存的原图数据;2. Display card on-board memory (VRAM) 3111: Each application program execution environment formed by the execution of each application program 311 draws a series of visual original image content that can be displayed on the display periphery, and converts these original images Stored in the display card memory 3111 on the graphics card; wherein, each element of the first original picture will be written into the display card memory 3111, and each subsequent original picture has only the same Only the different parts of the previous original image will be written into the display card onboard memory 3111 to update the original image data stored therein;
3.编码3112:通过绘图卡上的图形处理编码器(Graphic Processing UnitEncoder;简称GPU Encoder)自绘图卡控制下的该显示卡载存储器3111中读取该些原图加以编码成串流(Stream)形式;3. Encoding 3112: Read the original images from the on-board memory 3111 of the display card under the control of the graphics card through the Graphic Processing Unit Encoder (GPU Encoder) on the graphics card and encode them into a stream (Stream) form;
4.串流3113:自该图形处理编码器读取该串流3113并经由网络设备34传送给位于远端的用户端91,使该用户端91可将该些原图以网页形式显示于用户端91的浏览器上。本发明中所述的用户端91浏览器,并非仅狭义地局限于例如微软公司开发的InternetExplorer等等的互联网络浏览器,而是泛指可以将用户端91自互联网络所接收到的影像内容(例如该些原图)显示于用户端91的显示屏幕上的浏览器。4. Stream 3113: Read the stream 3113 from the graphic processing encoder and send it to the remote client 91 via the network device 34, so that the client 91 can display the original images in the form of web pages to the user on the browser of Terminal 91. The client 91 browser described in the present invention is not only narrowly limited to Internet browsers such as Internet Explorer developed by Microsoft Corporation, but generally refers to the image content that can be received by the client 91 from the Internet. (such as these original images) are displayed on the browser on the display screen of the client terminal 91 .
由于绘制原图的操作可由特定元件状态或配置发生改变时所驱动,所以,在产生一系列原图的过程中,可以只把有改变的部分图像元件更新到先前已绘制过的原图即可,不需把整个新原图全部由服务器31内的系统存储器全部重新写入显示卡载存储器3111中,由此可以减少写入数据量、降低对服务器31的中央处理器的需求、进而提高处理效率。当需要将原图编码时,图形处理编码器将直接自显示卡载存储器3111读取当前的原图并加以编码串流后传出,所以并不会额外占用服务器31内的总线的传输频宽、也不会增加服务器31内的中央处理器的工作负担。由此,本发明以图形处理器提升可互动内容浏览服务的系统3与方法相较于现有技术将具有以下优点:Since the operation of drawing original images can be driven by changes in the status or configuration of specific components, in the process of generating a series of original images, only some of the image components that have changed can be updated to the original images that have been drawn before. , it is not necessary to rewrite the entire new original image into the display card memory 3111 from the system memory in the server 31, thereby reducing the amount of written data, reducing the demand on the central processing unit of the server 31, and improving processing efficiency . When the original image needs to be encoded, the graphics processing encoder will directly read the current original image from the display card memory 3111 and encode it for streaming, so it will not occupy the transmission bandwidth of the bus in the server 31 , will not increase the workload of the central processing unit in the server 31. Therefore, compared with the prior art, the system 3 and method of the present invention for enhancing interactive content browsing services with a graphics processor will have the following advantages:
1.每一服务器31、32将可以同时执行更多数量的应用程序311、312而不至于降低服务效能,因为本发明的方法并不会把显示周边的输出传输到服务器31、32的作业系统层控制下的软件或硬件编码器;1. Each server 31, 32 will be able to execute a larger number of application programs 311, 312 at the same time without reducing service performance, because the method of the present invention will not transmit the output of the display periphery to the operating system of the server 31, 32 Software or hardware encoder under layer control;
2.每一服务器31、32将可以提供更高的服务容量给更多的用户端91、92、93来同时使用,因为本发明的方法大幅减少了总线频宽的消耗;2. Each server 31, 32 will be able to provide higher service capacity to more clients 91, 92, 93 to use simultaneously, because the method of the present invention greatly reduces the consumption of bus bandwidth;
3.使用绘图卡内的图形处理编码器35来直接对原图编码可具有更高的工作效率;3. Using the graphics processing encoder 35 in the graphics card to directly encode the original image can have higher work efficiency;
4.相对减少服务器31、32提供此类服务时的能源消耗。4. Relatively reduce the energy consumption when the servers 31 and 32 provide such services.
如图4所示,在本发明的一实施例中,各服务器4分别包括有:至少一中央处理器模块41以及至少一绘图卡42。As shown in FIG. 4 , in an embodiment of the present invention, each server 4 includes: at least one CPU module 41 and at least one graphics card 42 .
该中央处理器模块41包括有至少一中央处理器40(CPU)且执行有一作业系统411(OS),且在该作业系统411下执行有至少一应用程序4121(以多个应用程序为佳),并由中央处理器40来控制该作业系统411以及该些应用程序4121的运作以协同执行影像与音讯数据的处理。其中,所执行的各个应用程序4121分别构成一应用程序执行环境412、413以供位于远端的一用户端(本图未示)所连线及使用,使已连线的该用户端可以通过该应用程序执行环境412、413提出一读取要求以便自服务器4读取一内容。各个绘图卡42分别包括有一显示卡载存储器421以及至少一图形处理编码器422、423、424(以多个图形处理编码器为佳)。其中,各个应用程序执行环境412、413是分别对应于其中之一该图形处理编码器422、423,且该应用程序执行环境412、413至少产生一原图4211、4212储存于该显示卡载存储器421中。之后,依据该已连线的用户端的该读取要求,对应的该图形处理编码器422是自该显示卡载存储器421取出对应的该原图4211并加以编码成预定格式的串流后传送给该用户端。The central processing unit module 41 includes at least one central processing unit 40 (CPU) and executes an operating system 411 (OS), and at least one application program 4121 (preferably multiple application programs) is executed under the operating system 411 , and the central processing unit 40 controls the operation of the operating system 411 and the application programs 4121 to coordinate the processing of image and audio data. Wherein, each executed application program 4121 constitutes an application program execution environment 412, 413 for connection and use of a client terminal (not shown in this figure) located at the far end, so that the connected client terminal can pass through The application execution environment 412 , 413 issues a read request to read a content from the server 4 . Each graphics card 42 includes a display card memory 421 and at least one graphics processing encoder 422 , 423 , 424 (multiple graphics processing encoders are preferred). Wherein, each application program execution environment 412, 413 is respectively corresponding to one of the graphics processing encoders 422, 423, and the application program execution environment 412, 413 at least generates an original image 4211, 4212 and stores it in the display card memory 421 in. Afterwards, according to the reading request of the connected client, the corresponding graphic processing encoder 422 takes out the corresponding original image 4211 from the display card onboard memory 421 and encodes it into a stream in a predetermined format and transmits it to the client.
于本实施例中,所述的作业系统411可以是一原生作业系统(Native OS)为较佳,例如但不局限于:Windows XP、Windows Vista、Windows 7等作业系统。并且,用户端自服务器4所读取的内容是一可互动内容浏览服务(Interact-able Content Browsing Service;简称ICB)的内容,其可以一网页(webpage)的形式显示于该用户端的浏览器上,且于该网页中包括有该原图4211。于本发明中,所述的可互动内容浏览服务(Interact-able ContentBrowsing Service;简称ICB)的内容,其并非只是单纯自服务器接收影像档(或影像串流)并加以播放于用户端上而已,而是用户端可以互动式地控制、变更所显示的内容。若以线上游戏为例,则在用户端所执行的用户端游戏程序本身并不会直接绘制欲显示于用户端上的原图,而是会将来自用户端的输入周边(例如滑鼠、方向键或功能键、或触控式屏幕等)的操作讯号转换成控制讯息后传输给位于远端系统内的服务器,并由服务器端依据该些控制讯息来绘制产生该些原图及编码串流、之后再回传给用户端加以显示。因此,于用户端上所显示的原图内容实际上会依据用户端的输入周边的操作讯号而变化,导致用户端的使用者会有原图是在用户端内所绘制的错觉,然而事实上该些原图却是由远端的ICB系统所产生,所以于用户端的运算负载可大幅降低。In this embodiment, the operating system 411 may preferably be a native operating system (Native OS), such as but not limited to: Windows XP, Windows Vista, Windows 7 and other operating systems. Moreover, the content read by the client from the server 4 is the content of an interactive content browsing service (Interact-able Content Browsing Service; ICB for short), which can be displayed on the browser of the client in the form of a webpage. , and the original image 4211 is included in the webpage. In the present invention, the content of the Interact-able Content Browsing Service (Interact-able Content Browsing Service; ICB for short) does not simply receive video files (or video streams) from the server and play them on the client. Instead, the user terminal can interactively control and change the displayed content. Taking an online game as an example, the client game program itself executed on the client does not directly draw the original image to be displayed on the client, but uses the input peripherals from the client (such as mouse, direction, etc.) keys or function keys, or touch screen, etc.) the operation signals are converted into control messages and then transmitted to the server in the remote system, and the server draws the original images and coded streams according to the control messages , and then send it back to the client for display. Therefore, the content of the original image displayed on the client terminal will actually change according to the input peripheral operation signals of the client terminal, causing the user of the client terminal to have the illusion that the original image is drawn in the client terminal, but in fact these The original image is generated by the remote ICB system, so the computing load on the user side can be greatly reduced.
于本实施例中,所述的该读取要求是已连线的该用户端欲将由该应用程序执行环境412所产生的该原图4211以网页形式显示于已连线的该用户端以供浏览的要求。并且,该应用程序执行环境412会根据该读取要求而提出一应用程序介面(API)转向事件4122,使该对应的该图形处理编码器422依据该应用程序介面(API)转向事件4122来自该显示卡载存储器421取出对应的原图4211并加以编码串流后传送给用户端,而不需经由该中央处理器40来对该原图4211进行编码串流运算、也不需将原图4211数据传输于系统存储器与显示卡载存储器421之间而占用总线频宽。In this embodiment, the read request is that the connected client intends to display the original image 4211 generated by the application execution environment 412 on the connected client in the form of a webpage for Browse requests. And, the application program execution environment 412 will propose an application program interface (API) turn event 4122 according to the read request, so that the corresponding graphics processing encoder 422 can come from the application program interface (API) turn event 4122 according to the application program interface (API) turn event 4122 The display card on-board memory 421 takes out the corresponding original image 4211 and transmits it to the client after being encoded and streamed, without going through the central processing unit 40 to perform encoding and streaming operations on the original image 4211, and without encoding the original image 4211 Data transmission between the system memory and the onboard memory 421 occupies bus bandwidth.
以下为说明本发明在发现应用程序介面(API)转向事件后如何以图形处理编码器自显示卡载存储器中取出原图并加以编码串流的程序原始码其中之一范例。请注意,以下的程序原始码虽然是以nVidia CUDA为例来编码,但却并不局限于此例;由于以下的程序原始码乃属于本项技术领域中具有通常知识者所能理解、且可依实际需求的不同而修改其内容,所以将不予详述其内容,且以下的程序原始码也不应用以限制本发明的可实施范围。The following is one example of the program source code for how to use the graphic processing encoder to fetch the original image from the on-board memory of the display card and encode the stream after the discovery of the application programming interface (API) turning event of the present invention. Please note that although the following program source code is coded with nVidia CUDA as an example, it is not limited to this example; because the following program source code belongs to those with ordinary knowledge in this technical field can understand and can Its content is modified according to different actual needs, so its content will not be described in detail, and the following program source code should not be used to limit the scope of the present invention.
请参阅图5,为说明本发明在可互动内容浏览服务(ICB)执行环境下的服务器端操作的一实施例流程图,其包括有下列步骤:Please refer to FIG. 5 , which is a flow chart of an embodiment illustrating the server-side operation of the present invention in an interactive content browsing service (ICB) execution environment, which includes the following steps:
步骤501:开始。Step 501: start.
步骤502:本发明的可互动内容浏览(ICB)服务系在执行于一服务器中的作业系统(例如但不局限于:Windows作业系统)环境下来操作,并通过执行一ICB应用程序来构成一ICB执行环境,以提供位于远端的用户端来连线并读取ICB内容的服务,接着执行步骤503。Step 502: The Interactive Content Browsing (ICB) service of the present invention operates under the environment of an operating system (such as but not limited to: Windows operating system) executed in a server, and forms an ICB by executing an ICB application program Execute the environment to provide a remote client terminal to connect and read ICB content, and then execute step 503 .
步骤503:检查用户端所欲读取的ICB内容是否包含影片(Video)或是音讯(Audio)的输出?倘若有包含影片则执行步骤504,若有包含音讯则执行步骤者,若两都不包含则回到步骤502也就是等待下一个ICB内容的读取要求。Step 503: Check whether the ICB content to be read by the client includes video (Video) or audio (Audio) output? If there is video, then execute step 504, if there is audio, then execute step 504, if both are not included, then return to step 502, that is, to wait for the next ICB content reading request.
步骤504:ICB内容依据其被转向至ICB执行环境的类型,来使用作业系统的视觉化输出的应用程序介面(API),此步骤的操作系由步骤505来决定。Step 504: The ICB content uses the application program interface (API) of the visual output of the operating system according to the type of ICB execution environment it is diverted to. The operation of this step is determined by step 505 .
步骤505:检查ICB内容的类型为何?倘若ICB内容的类型为视窗图形装置介面(Windows GDI)的影片,则执行步骤506,若ICB内容的类型为多媒体编程介面(DirectX)的影片,则执行步骤507,而若ICB内容的类型为供网络浏览(Web Browsing)的影片,则执行步骤508。Step 505: Check the type of ICB content? If the type of ICB content is the film of Windows Graphics Device Interface (Windows GDI), then execute step 506, if the type of ICB content is the film of multimedia programming interface (DirectX), then execute step 507, and if the type of ICB content is for If the movie of Web Browsing is used, step 508 is performed.
步骤506:将影像驱动程序的GDI绘图功能转向至显示卡载存储器(VRAM)。Step 506: Transfer the GDI drawing function of the video driver to the VRAM.
步骤507:由多媒体编程介面提供的图像是储存于显示卡载存储器中。Step 507: The image provided by the multimedia programming interface is stored in the on-board memory of the display card.
步骤508:将显示卡载存储器中的绘图内容转向提供。Step 508: Turn the drawing content in the memory on the display card to provide.
步骤509:每一ICB执行环境分别有其自己的音讯驱动介面,此步骤的操作是依据步骤510来执行。Step 509: Each ICB execution environment has its own audio driver interface, and the operation of this step is performed according to step 510.
步骤510:ICB内容请求使用作业系统的音讯输出应用程序介面被指向至目前ICB执行环境下的音讯驱动程序。Step 510: The ICB content request is directed to the audio driver in the current ICB execution environment using the audio output API of the operating system.
请参阅图6,为说明本发明以图形处理器提升可互动内容浏览服务方法于系统端的一实施例流程图,其包括有下列步骤:Please refer to FIG. 6 , which is a flow chart of an embodiment of the method for enhancing interactive content browsing service on the system side by using a graphics processor according to the present invention, which includes the following steps:
步骤550:开始。Step 550: Start.
步骤551:本发明的以图形处理器提升可互动内容浏览服务系统接受来自一用户端的一ICB服务的要求,接着执行步骤552。Step 551 : The interactive content browsing service system enhanced by graphics processing unit of the present invention accepts an ICB service request from a client, and then executes step 552 .
步骤552:本发明的ICB服务发送服务器内的一可用位置给该用户端,接着执行步骤553。Step 552: The ICB service of the present invention sends an available location in the server to the client, and then executes Step 553.
步骤553:检查是否找到一可用位置?倘若有找到可用位置则执行步骤557,倘若没有找到可用位置则执行步骤554。Step 553: Check if an available location is found? If an available location is found, then step 557 is executed, and if no available location is found, then step 554 is executed.
步骤554:等待可用位置,接着执行步骤555。Step 554: Wait for an available location, then execute Step 555.
步骤555:检查是否逾时?倘若已逾时则执行步骤556,倘若尚未逾时则跳回执行步骤551。Step 555: Is the check timed out? If it has expired, execute step 556, and if it has not expired, then jump back to execute step 551.
步骤556:结束。Step 556: end.
步骤557:以特定内容来执行ICB执行环境,接着执行步骤558。Step 557: Execute the ICB execution environment with specific content, then execute step 558.
步骤558:检查用户端所欲读取的ICB内容是否包含影片(Video)或是音讯(Audio)的输出?倘若有包含影片则执行步骤559,若有包含音讯则执行步骤562,若两都不包含则回到步骤557。Step 558: Check whether the ICB content to be read by the client includes video (Video) or audio (Audio) output? If there is a video, then step 559 is executed, if there is audio, then step 562 is executed, if neither is included, then step 557 is returned.
步骤559:图形处理编码器自ICB执行环境取出视觉化内容,接着执行步骤560。Step 559 : the graphic processing encoder fetches the visualization content from the ICB execution environment, and then executes step 560 .
步骤560:以互动式串流协定将ICB内容编码成串流形式并传送给用户端,接着执行步骤561。Step 560 : Encode the ICB content into a stream form by using the Interactive Streaming Protocol and transmit it to the client, and then perform step 561 .
步骤561:影片实况编码器自ICB执行环境取出视觉化内容。Step 561: The video live encoder retrieves the visualization content from the ICB execution environment.
步骤562:音讯实况编码器自ICB执行环境取出音讯化内容,接着执行步骤560。Step 562: The audio live encoder fetches the audio content from the ICB execution environment, and then executes step 560.
请参阅图7,为说明本发明以图形处理器提升可互动内容浏览服务方法于用户端操作的一实施例流程图,其包括有下列步骤:Please refer to FIG. 7 , which is a flow chart illustrating an embodiment of the present invention using a graphics processor to enhance the interactive content browsing service method to operate on the client side, which includes the following steps:
步骤61:执行中。于用户端持续执行一用户端应用程序,使用户端可连线到本发明以图形处理器提升可互动内容浏览服务(ICB)系统、以连线并使用由该系统内的其中的一服务器中所执行的其中的一服务器端应用程序所构成的应用程序执行环境、进而有能力得以读取由该被使用的服务器内的其中的一绘图卡所编码串流的若干原图。Step 61: Executing. Continuously execute a client application program on the client end, so that the client end can connect to the interactive content browsing service (ICB) system of the present invention with a graphics processor, so as to connect and use one of the servers in the system The application program execution environment constituted by one of the executed server-side application programs has the ability to read some original images coded and streamed by one of the graphics cards in the used server.
步骤62:连接于ICB系统的用户端等待来自其输入周边(例如但不局限于:鼠标、方向键或功能键、键盘、或触控式屏幕等)的操作讯号并将其转换成对应的控制讯息。Step 62: The client connected to the ICB system waits for operation signals from its input peripherals (such as but not limited to: mouse, direction keys or function keys, keyboard, or touch screen, etc.) and converts them into corresponding controls message.
步骤63:是否有操作讯息?若否则回到步骤62,若是则执行步骤64。Step 63: Is there any operation message? If otherwise, return to step 62, and if yes, execute step 64.
步骤64:将用户端的控制讯息传送给ICB系统的服务器。Step 64: Send the control message of the client to the server of the ICB system.
步骤65:由ICB系统的服务器检查是否能辨识该控制讯息?若否,则执行步骤66,由ICB系统的服务器将该控制讯息丢弃后,再回到步骤62。若是,则执行步骤67。Step 65: Check whether the control message can be recognized by the server of the ICB system? If not, execute step 66, and return to step 62 after the server of the ICB system discards the control message. If yes, execute step 67.
步骤67:由ICB系统的服务器处理相对应的控制讯息并将控制讯息传给执行于服务器内所执行的相对应的应用程序环境。Step 67: The server of the ICB system processes the corresponding control message and sends the control message to the corresponding application program environment executed in the server.
步骤67:由ICB系统的服务器内所执行的应用程序环境根据该控制讯息来产生相对应的视觉化内容(例如原图)。Step 67: The application program environment executed in the server of the ICB system generates the corresponding visual content (such as the original image) according to the control message.
步骤68:接续至图8所示的播放程序。Step 68: Continue to the playback program shown in FIG. 8 .
请参阅图8,为说明本发明以图形处理器提升可互动内容浏览服务方法于用户端播放程序的一实施例流程图,其包括有下列步骤:Please refer to FIG. 8 , which is a flow chart of an embodiment of a method of using a graphics processor to enhance an interactive content browsing service to play a program on a client terminal according to the present invention, which includes the following steps:
步骤691:于用户端的播放程序开始。Step 691: Start the playback program on the client side.
步骤692:由用户端自位于远端ICB系统内的服务器接收原图经编码后的串流。Step 692: The UE receives the encoded stream of the original image from the server located in the remote ICB system.
步骤693:用户端将串流解码并播放于用户端的显示装置上。Step 693: The UE decodes the stream and plays it on the display device of the UE.
步骤694:是否有欲结束播放的结束信号?若否,则回到步骤692。若是,则执行步骤695以结束播放程序。Step 694: Is there an end signal to end playing? If not, go back to step 692. If yes, then execute step 695 to end the playing procedure.
以上所述的实施例不应用于限制本发明的可应用范围,本发明的保护范围应以本发明的申请专利范围内容所界定技术精神及其均等变化所含括的范围为主者。即大凡依本发明申请专利范围所做的均等变化及修饰,仍将不失本发明的要义所在,亦不脱离本发明的精神和范围,故都应视为本发明的进一步实施状况。The above-mentioned embodiments should not be used to limit the applicable scope of the present invention, and the protection scope of the present invention should be based on the technical spirit defined by the content of the patent application of the present invention and the range included in equal changes. That is, all equivalent changes and modifications made according to the patent scope of the present invention will still not lose the gist of the present invention, nor depart from the spirit and scope of the present invention, so all should be regarded as further implementation status of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110352873.5A CN103106054B (en) | 2011-11-09 | 2011-11-09 | System and method for improving interactive content browsing service through graphics processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110352873.5A CN103106054B (en) | 2011-11-09 | 2011-11-09 | System and method for improving interactive content browsing service through graphics processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103106054A CN103106054A (en) | 2013-05-15 |
| CN103106054B true CN103106054B (en) | 2017-05-24 |
Family
ID=48313947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110352873.5A Active CN103106054B (en) | 2011-11-09 | 2011-11-09 | System and method for improving interactive content browsing service through graphics processor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103106054B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083348B (en) * | 2019-04-04 | 2023-09-26 | 广州视源电子科技股份有限公司 | Drawing method, device, equipment and storage medium based on multi-process browser |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129394A (en) * | 2010-01-14 | 2011-07-20 | 优必达科技有限公司 | Distributed Computing Method and System |
-
2011
- 2011-11-09 CN CN201110352873.5A patent/CN103106054B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129394A (en) * | 2010-01-14 | 2011-07-20 | 优必达科技有限公司 | Distributed Computing Method and System |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103106054A (en) | 2013-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103329553B (en) | Composite video stream with stateless compression | |
| US8856212B1 (en) | Web-based configurable pipeline for media processing | |
| US20140108940A1 (en) | Method and system of remote communication over a network | |
| CN104052797B (en) | Distribute control system, dissemination system and distribution control method | |
| US8799405B2 (en) | System and method for efficiently streaming digital video | |
| US9723337B2 (en) | Distribution control system and distribution system | |
| CN112843676B (en) | Data processing method, device, terminal, server and storage medium | |
| US20230379373A1 (en) | Information switching and sharing method, device, electronic apparatus, and storage medium | |
| CN105637886A (en) | A server for providing a graphical user interface to a client and a client | |
| US9578079B2 (en) | Distribution control system, distribution system, distribution control method, and computer-readable storage medium | |
| CN114356465B (en) | Desktop cloud system and method, device and medium for providing virtual desktop | |
| CN102033726A (en) | Display method and server | |
| US9483996B2 (en) | System and method of leveraging GPU resources to increase performance of an interact-able content browsing service | |
| KR102078576B1 (en) | Method for cloud streaming service using compression of alpha data and apparatus for the same | |
| WO2024037110A1 (en) | Data processing method and apparatus, device, and medium | |
| CN117676241A (en) | Digital factory large scene display method and system based on server three-dimensional rendering | |
| CN102770827B (en) | Method for displaying multimedia content on a screen of a terminal | |
| CN114302176B (en) | Video playback method and device | |
| CN113542335A (en) | Information sharing method and device, electronic equipment and storage medium | |
| CN103106054B (en) | System and method for improving interactive content browsing service through graphics processor | |
| CN109933735A (en) | Scheduling method, web page rendering method, web page display method and device thereof | |
| CN107066106A (en) | Remote management system and method thereof | |
| CN114528515A (en) | Model rendering method and device, electronic equipment and computer readable storage medium | |
| TWI579707B (en) | System and method of leveraging gpu resources to enhance performance of an interact-able content browsing service | |
| US20230236856A1 (en) | Desktop Cloud System and Related Method, Apparatus, Device, and Medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180119 Address after: The Cayman Islands Dakaiman island KY1-1112 cricket square willow house 4 floor P.O. Box 2804th Patentee after: Ubitus Inc. Address before: The British Virgin Islands holding box 957th, postal center in Rhode Island tura overseas companies Patentee before: Ubitus Inc. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200907 Address after: 5 / F, Chi Park building, 2-3-18ym, Tokyo, 105-0014, Japan Patentee after: Yobeta Co.,Ltd. Address before: The Cayman Islands Dakaiman island KY1-1112 cricket square willow house 4 floor P.O. Box 2804th Patentee before: Ubida |
|
| TR01 | Transfer of patent right |