[go: up one dir, main page]

WO2018130165A1 - Cloud computing mobile terminal and operation method therefor - Google Patents

Cloud computing mobile terminal and operation method therefor Download PDF

Info

Publication number
WO2018130165A1
WO2018130165A1 PCT/CN2018/072168 CN2018072168W WO2018130165A1 WO 2018130165 A1 WO2018130165 A1 WO 2018130165A1 CN 2018072168 W CN2018072168 W CN 2018072168W WO 2018130165 A1 WO2018130165 A1 WO 2018130165A1
Authority
WO
WIPO (PCT)
Prior art keywords
cloud computing
mobile terminal
cloud
local
data
Prior art date
Application number
PCT/CN2018/072168
Other languages
French (fr)
Chinese (zh)
Inventor
杨立群
Original Assignee
杨立群
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杨立群 filed Critical 杨立群
Priority to DE112018000226.8T priority Critical patent/DE112018000226B4/en
Publication of WO2018130165A1 publication Critical patent/WO2018130165A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0896Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Definitions

  • the invention belongs to the field of cloud computing and mobile communication, and particularly relates to a cloud computing mobile terminal and a working method thereof.
  • Intelligent mobile terminals such as smart phones, tablets, and portable computers, have become the network terminal devices that people can't keep in every day.
  • the smart phone terminal product has a short update cycle, and consumers tend to replace the new version of the mobile terminal product on average every year.
  • these updated products usually stack performance parameters such as CPU computing power, memory size, and storage capacity, while other hardware (such as display screens and network adapters) are less updated. Too frequent replacement of electronic products puts economic pressure on consumers and is not conducive to energy conservation and environmental protection.
  • their smart terminals often have excess performance and waste.
  • Mobile cloud computing is a new mode of delivery and use of IT resources or information services. It is the product of introducing cloud computing into the mobile Internet.
  • cloud servers are usually provided to provide cloud services for mobile terminals to log in and synchronize data and events.
  • the mobile terminal only has the basic function of displaying video, playing sound, and transmitting the user's input to the cloud server, and other functions are provided by the cloud server, reducing the dependence on the hardware performance of the mobile terminal and reducing The cost of the mobile terminal is conducive to the expansion and upgrade of the mobile terminal function.
  • the solution in the patent document CN102377739A is limited to audio and video cloud synchronous transmission and decoding and related event operations, and the application scope is limited, and the problem of GUI presentation and synchronization of the mobile terminal, cloud computing resource scheduling, media redirection acceleration, etc. cannot be solved.
  • the cloud server provides a virtual machine to run the Android system and simulates the virtual mobile terminal, and then can be accessed by the physical mobile terminal in a manner similar to remote assistance.
  • the physical mobile terminal still needs a certain configuration to run the APP for accessing the cloud virtual machine, and also needs to operate the complex framework of the same Android system, and adopts the method of direct remote control. It is necessary to screen the desktop of the remote system, and the data traffic is huge, the speed is slow, and the card screen is easy.
  • the present invention solves the above problems by providing a cloud computing mobile terminal and a working method thereof.
  • the technical solution adopted by the present invention provides a cloud computing mobile terminal, which includes local hardware, and the local hardware includes a human-machine interaction device, a local memory, a communication transmission unit, and a microprocessor.
  • the cloud computing mobile terminal further includes: a basic system architecture for operating the local hardware to implement basic communication and application functions; and a cloud computing service layer for interacting with a cloud system in the remote cloud computing server,
  • the cloud computing service layer operates based on the basic system architecture, the cloud system is a user customization system running based on cloud computing resources; and a transmission management module for managing and monitoring the communication interface and cloud computing of the cloud computing service layer
  • a transmission channel between servers which includes an instruction channel, an application data channel, and a file data stream channel.
  • the instruction channel transmits an instruction generated by the user operating the human-machine interaction device and an instruction issued by the cloud computing server;
  • the application data channel transmits the application running data, including the GUI synchronization refresh data;
  • the file data stream channel is used for The media file data or the basic user file is transmitted; wherein the command channel occupies the network resource with a higher priority than the application data channel, and the application data channel occupies the network resource with a higher priority than the file data stream channel.
  • the transmission management module further includes: one or more buffers for buffering real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server.
  • the buffer allocated for the instruction channel has a higher speed priority than the other channels, and the buffer allocated for the file data stream channel is larger than the other channels.
  • the communication protocol adopted by the transmission management module includes TCP, HTTP, UDP or Web Socket.
  • the cloud computing service layer includes a GUI management unit that generates a corresponding local GUI interface in the display of the human-machine interaction device according to the activated GUI interface of the cloud system through an application data channel, and real-time Docking command channels for real-time synchronization of local and cloud GUI interfaces.
  • the cloud computing service layer includes a multimedia processing unit, configured to decode multimedia compressed data sent by the cloud computing server and present by local hardware.
  • the multimedia processing unit also hard decodes the multimedia compressed data by calling local hardware resources.
  • the cloud computing mobile terminal further includes a resource allocation module, configured to schedule and allocate local and/or cloud hardware and software resources to the cloud computing service layer.
  • the resource allocation module adjusts the allocation amount of the software and hardware resources according to the request amount and the request priority of the cloud computing service layer and the transmission management module, and according to network throughput of the communication transmission unit.
  • the resource allocation module includes: a memory fusion unit, configured to fuse memory resources of other cloud computing devices by using a cloud computing server; and a storage fusion unit, configured to integrate storage resources of other cloud computing devices by using a cloud computing server.
  • the basic system architecture includes a local application service layer for providing a basic local application running environment; the local application service layer is synchronized with an application service layer of the cloud system in the cloud computing server.
  • the basic system architecture includes an Android architecture, a Windows architecture, and a Unix architecture.
  • the communication transmission unit comprises a mobile communication module, wherein the mobile communication module comprises a 2G, 3G, 4G and/or 5G network communication mode.
  • the communication transmission unit further includes a Wi-Fi communication module, a Bluetooth communication module, and/or a near field communication module.
  • the local hardware further includes a dedicated hard decoder for multimedia processing.
  • Another aspect of the present invention provides a method for operating a cloud computing mobile terminal, including the following steps: A, verifying a user request, accessing a cloud computing server; B, receiving GUI data and application of a customized cloud system running based on the cloud computing resource Program data, generating a local GUI interface and associating corresponding local application services; C, capturing user actions received by the local hardware, and collecting state parameters of the cloud computing mobile terminal, converting to user instructions and application operation data, and then transmitting to the cloud Computing server; D, receiving GUI data and application data of the updated cloud system, updating the local GUI interface and synchronizing the corresponding local application service; E, determining whether the user issues an exit instruction, exiting the cloud computing service, otherwise returning to the step C.
  • the working method further includes: managing and monitoring an instruction channel, an application data channel, and a file data flow channel between the communication interface of the cloud computing mobile terminal and the cloud computing server, to implement real-time communication; scheduling and allocating local and / or cloud hardware and software resources to optimize the cloud computing service to run locally.
  • a third aspect of the present invention also provides a computing device comprising a storage and a processor, wherein the processor executes program commands stored in the memory to perform the steps of the working method described above.
  • the invention has the beneficial effects that the cloud computing terminal is proposed, which fills the technical blank in the field, extends the hardware replacement period of the mobile terminal, satisfies the needs of the user to use the customized system and various systems in the same terminal, and provides the cloud computing mobile terminal. Resource provisioning and scheduling with the server to mobilize idle resources for integration and sharing.
  • FIG. 1 is a schematic diagram of an application of a cloud computing mobile terminal according to the present invention.
  • FIG. 2 is a block diagram of a cloud computing mobile terminal according to the invention, and also shows a schematic block diagram of a cloud computing server;
  • FIG. 3 is a flowchart showing the operation of a cloud computing mobile terminal according to the invention, and also showing a collaborative working flowchart of the cloud computing server;
  • FIG. 4 is a flow chart showing the transmission management during the working process of the cloud computing mobile terminal according to the present invention.
  • FIG. 5 is a flow chart showing a multimedia redirection process in the working process of a cloud computing mobile terminal according to the present invention.
  • FIG. 1 is a schematic diagram of an application of a cloud computing mobile terminal according to the present invention, wherein the cloud computing mobile terminal 1 and the cloud computing server 2 are networked through the communication device 3, and the networking manner adopted may be a wired connection, a wireless connection, or Or any combination thereof.
  • a mobile communication connection for example, 2G, 3G, 4G, or 5G communication mode
  • a wide area network for example, a Wi-Fi network
  • Ethernet network for example, Wi-Fi network, or Wi-Fi network.
  • the cloud computing mobile terminal 1, the cloud computing server 2, and the communication device 3 may each be plural in number.
  • the cloud computing server 2 includes a multiprocessor system, a small computer, a mainframe computer, a distributed computing system, a cluster computing system, and the like.
  • the communication device 3 includes a network adapter, a network switch, a router, a modem, an optical fiber/twisted pair line, a wireless AP, an antenna, a mobile communication base station, and the like.
  • the cloud computing server 2 may include a cloud cluster architecture 21, a network manager 22, a processor 23, a scheduler 24, a memory 25, and the like.
  • the cloud cluster architecture 21 integrates the cloud terminal resources to provide an operating environment for the plurality of cloud systems, and each cloud system internally simulates running multiple cloud systems in sequence, and the cloud system processes the corresponding cloud computing mobile terminal 1 communication through the network manager 22.
  • the processor 23 may cause the scheduler 24 to schedule resources from various cloud computing devices in the cloud cluster network or from cloud computing mobile terminals according to the current operating conditions of the cloud computing server.
  • the processor 23 can analyze the idle NAS (Network Attached Storage) resources connected to the cloud computing server 2 in the cloud cluster network, and the scheduler 24 The available storage content of the NAS is addressed to the memory 25 for internal use by the cloud computing server 2 or for use by one or more cloud computing mobile terminals 1.
  • the processor 23 may analyze the idle memory resource of the cloud computing mobile terminal 1 connected to the cloud computing server 2, and the cloud computing mobile terminal 1 is configured by the scheduler 24.
  • the available idle memory resources are integrated into the memory pool in the cloud computing server 2.
  • the cloud computing mobile terminal 1 runs an operating system that can switch between a base mode and a cloud computing mode.
  • the basic mode of the operating system only basic communication functions (such as calling, sending and receiving text messages, FM radio) and applications (APP) can be run in the cloud computing mobile terminal 1 (for example, notepad, calculator, offline map)
  • the cloud computing mobile terminal 1 can interact with the cloud system running in the cloud computing server 2 through a network, such as preferably through a high-speed 5G network, and load the rich hardware resources of the cloud system and call the operation.
  • a network such as preferably through a high-speed 5G network
  • the cloud computing mobile terminal 1 is connected to the corresponding cloud system simulated in the cloud computing server 2, and the user interface (UI) of the mobile terminal 1 is switched from the call input page 10 to the APP.
  • the function page 10' in turn, synchronizes the UI of the cloud computing mobile terminal 1 with the pseudo-generation interface 10" of the cloud system.
  • the cloud system that simulates running does not actually need to display the UI graphics, so only FIG.
  • the pseudo-generated interface 10" of the cloud system is taken as a schematic description.
  • the local hardware of the cloud computing mobile terminal 1 includes a human-machine interaction device 150, a microprocessor 153, a decoder 154, a memory 155, a communication transmission unit 156, and the like.
  • the human-machine interaction device 150 may include a touch screen 151 and a fingerprint device 152.
  • the human-machine interaction device 150 may further include: one or more input devices, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, etc.; and one or more
  • the output device is, for example, one or more displays, speakers, projectors, vibration feedback devices, and the like.
  • the input device and the output device can be connected to the cloud computing mobile terminal 1 through a wired connection, a wireless connection, or any combination thereof.
  • an input device or output device from another mobile terminal can be used as an input or output device of the current mobile terminal.
  • the decoder 154 is for decoding the digital video and audio data stream to an analog video and audio signal.
  • the decoder 154 may be a dedicated hardware decoding chip or a decoding processing unit integrated in the microprocessor 153.
  • the cloud computing mobile terminal 1 may further include an encoder for compressing the analog video and audio signals into data encoded files.
  • the memories 155, 25 in the cloud computing mobile terminal 1 and the cloud computing server 2 generally employ computer storage media.
  • the computer storage medium includes volatile and nonvolatile, removable and non-removable media that are applied to any method or technology to store information such as computer readable instructions or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital video disc (DVD) or other optical storage device, or any other device capable of storing the required information and by the corresponding device Media accessed.
  • the transmission medium herein typically stores computer readable instructions or other data in the form of "modulated data signals", such as carrier waves or other transmissions, and includes any information transmission medium.
  • the communication transmission unit 156 of the cloud computing mobile terminal 1 includes a mobile communication module, wherein the mobile communication module includes any one or more of 2G, 3G, 4G, and 5G network communication modes.
  • the communication transmission unit 156 also includes a Wi-Fi communication module, a Bluetooth communication module, and/or a near field communication module.
  • communication transmission unit 156 may include one or more communication connection elements that allow mobile terminal 1 to communicate with other devices. Further, communication connection elements may also include, but are not limited to, a modem, a radio frequency transmitter/receiver, Infrared port, USB connector or other interface.
  • the cloud computing mobile terminal 1 further includes a basic operating system architecture 12, a cloud computing service layer 11, and a transmission management module 13.
  • the cloud computing service layer 11 running based on the base system architecture 12 interacts with the cloud system associated with the remote cloud computing server 2 through the transport management module 13, as described further below.
  • the base system architecture 12 is used to operate local hardware to implement basic communication functions and applications that run the foundation.
  • the base system architecture 12 includes a kernel layer, a system core library, and an application layer.
  • the kernel layer provides core system services, such as security functions, memory management, process management, hardware drivers, etc.
  • the system core library provides system function library functions customized for the hardware of the cloud computing mobile terminal 1, and also includes some
  • the core application programming interface (API) the application layer contains multiple applications, such as SMS SMS client program, phone dialer, picture browser, web browser and so on.
  • system architecture can be developed based on the architecture of the underlying embedded system (eg, Linux, Unix, WinCE, etc.), and can be modified directly based on the architecture of an open source mobile embedded system (such as Andriod).
  • the underlying embedded system eg, Linux, Unix, WinCE, etc.
  • an open source mobile embedded system such as Andriod
  • the transmission management module 13 is configured to manage and monitor a transmission channel between the communication interface of the cloud computing service layer and the cloud computing server, where the transmission channel includes an instruction channel, an application data channel, and a file data stream channel.
  • the instruction channel transmits instructions generated by the user when operating the human-machine interaction device and instructions issued by the cloud computing server;
  • the application data channel transmits application running data, including GUI synchronous refresh data;
  • the file data stream channel is used for transmitting media
  • the file data or the basic user file wherein the command channel occupies the network resource with a higher priority than the application data channel, and the application data channel occupies the network resource with a higher priority than the file data stream channel.
  • the transport management module can also provide communication encryption means based on encryption protocols such as SSL, TLS, and the like.
  • the transmission management module 13 further includes: one or more buffers for buffering real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server.
  • the buffer allocated for the instruction channel has a higher speed priority than the other channels, and the buffer allocated for the file data stream channel is larger than the other channels.
  • the communication protocol adopted by the transmission management module includes TCP, HTTP, UDP or Web Socket.
  • the cloud computing service layer 11 runs a set of cloud computing function support components, including a security verification unit, a GUI management unit, a multimedia processing unit, a cloud synchronization monitoring unit, and a background management unit.
  • the security verification unit may be used to verify the user identity of the cloud computing mobile terminal, such as by verifying the account and password entered by the user through the touch screen 151, or the fingerprint input by the user through the fingerprint device 152, to log in to the operating system of the cloud computing mobile terminal 1 and/or Or access the user account in the cloud computing server 2.
  • the GUI management unit can be used to generate a default interface, such as the APP function page 10', and then display the corresponding local GUI interface in the display of the human interface device 150.
  • the GUI management unit is also used for real-time docking of local and cloud computing server instruction channels to realize real-time synchronization of the local terminal and the cloud system side GUI interface.
  • the GUI management unit displays a corresponding local GUI interface in the display of the human-machine interaction device according to the activated GUI interface of the cloud system through the application data channel, and directly connects the instruction channel in real time, and preferentially generates a local GUI. Interface, then synchronize the local GUI interface and the cloud GUI interface.
  • the GUI management unit immediately uses the cached data of the social APP (eg, friend page data) to locally generate a target for displaying the chat friend locally.
  • the interface and the cached friend online status identifier since the user's click operation instruction has been transmitted to the cloud computing server 2 through the instruction channel, triggering the corresponding cloud system to resolve the click action, and then the cloud computing server 2 returns the updated GUI data to
  • the GUI management unit performs update synchronization in a small amount on the target interface that has been pre-generated, such as updating the online status identifier of the chat friend.
  • Such a GUI update method is faster and more efficient than the traditional remote assistance-based interface transfer method (see Patent Document CN103345406A), and also significantly improves the interface fluency and the user's real-time operating experience.
  • a multimedia processing unit configured to decode the multimedia compressed data sent by the cloud computing server and present by using local hardware.
  • the multimedia processing unit to present the media: 1) server-side rendering, that is, after the video/audio file is pre-coded and decoded in the cloud system, the multimedia processing unit receives the image for display; 2) multimedia Redirection, also known as mobile rendering, video audio files are fragmented and packaged, and the multimedia processing unit soft decodes or directly hard decodes the multimedia compressed data by calling local hardware resources.
  • the multimedia redirection function is used in the above method to enable simultaneous activation of both the local mobile terminal and the cloud
  • the video and audio recorded in the cloud computing mobile terminal can be encoded and compressed by the multimedia processing unit, and then transmitted to the cloud system for transmission.
  • the above two methods have their own advantages and disadvantages: for the mode 1), the powerful computing resources of the cloud computing server 2 can be used for decoding and rendering, but the transmitted image and audio data have high requirements on the network; for the mode 2), the cloud system can be improved. Even the video concurrency density of the entire cloud computing server, using the display chip of the mobile terminal, improves the picture quality and smoothness of the video, saves bandwidth resources, but also increases the burden of the cloud computing mobile terminal.
  • the multimedia processing unit may switch the foregoing manner according to parameters such as network conditions, remaining power, and the like. For example, when the cloud computing mobile terminal accesses a stable WiFi network, mode 1 may be adopted, when the cloud computing mobile terminal accesses Mode 2 can be used when the network is full and the remaining power is sufficient.
  • the cloud computing mobile terminal 1 further includes a resource allocation module 14 for scheduling and distributing local and/or cloud hardware and software resources to the cloud computing service layer.
  • the resource allocation module 14 adjusts the allocation amount of the software and hardware resources according to the request amount and the request priority of the cloud computing service layer and the transmission management module, and according to the network throughput of the communication transmission unit.
  • the resource allocation module includes: a memory fusion unit, configured to fuse memory resources of other cloud computing devices by the scheduler 24 of the cloud computing server 2; and a storage fusion unit configured to fuse storage resources of other cloud computing devices by the cloud computing server.
  • the cloud computing device can include a distributed remote extension with the cloud computing server 2 or another cloud computing mobile terminal that has accessed the cloud computing server 2.
  • each cloud computing mobile terminal 1 can call idle resources (such as memory and storage resources) of remote extensions in the entire cloud platform network, and integrates them into the local host as an extension of local resources, so that the local host does not need to upgrade hardware. Use more external integration resources in the case.
  • FIG. 3 is a flow chart showing the operation of the cloud computing mobile terminal 1 according to the present invention. A flowchart of the synchronization assistance work of the cloud computing server 2 is also shown in FIG.
  • a method for operating a cloud computing mobile terminal 1 includes the following steps:
  • S102 Receive GUI data and application data of a user-customized cloud system running based on the cloud computing resource, generate a local GUI interface, and associate a corresponding local application service.
  • S103 Capture user actions received by the local hardware and collect state parameters of the cloud computing mobile terminal 1, convert the data into user instructions and application operation data, and then send the data to the cloud computing server.
  • S104 Receive GUI data and application data of the updated cloud system, update the local GUI interface, and synchronize the corresponding local application service.
  • S105 S106. Determine whether the user issues an exit instruction, and then exit the cloud computing service and then switch the local basic system interface, otherwise return to step S103.
  • the working method of the cloud computing server 2 includes the following steps:
  • S201 Pre-allocate the cloud system resource for running the cloud system according to the service registered by the user, optionally preloading the cloud system that the user last logged in or the cloud system that the user logs in by default;
  • the transmission management process is also run in the cloud computing mobile terminal 1, including the following steps:
  • S301 Monitor an instruction channel, an application data channel, and a file data flow channel between the communication interface of the cloud computing service layer and the cloud computing server.
  • the priority of the command channel for the network resource is higher than the application data channel, and the application data channel has a higher priority for the network resource than the file data stream channel;
  • the real-time data in the transmission channel is buffered during a real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server, and the buffer of the configuration command channel has a higher speed priority than other channels, and the configuration file data flows.
  • the volume of the track buffer is larger than the other channels.
  • the corresponding local GUI interface can be displayed in the display of the driven human-machine interaction device through the GUI channel of the activated application system, the real-time docking instruction channel is generated, the local GUI interface is preferentially generated, and the local GUI is synchronized. Interface and cloud GUI interface.
  • the multimedia redirection processing flow is also run in parallel in the cloud computing mobile terminal 1, including the following steps:
  • S402. Call local hardware resources to perform soft decoding or direct hard decoding on the multimedia compressed data.
  • the video and audio recorded by the cloud computing mobile terminal 1 are encoded and compressed, and then transmitted to the cloud system for redirected decoding and playing.
  • the mobile terminal running the basic system can realize rich user functions by relying on the cloud computing service, and also integrates the resources of the cloud computing network;
  • the user only needs to use any cloud computing mobile terminal to log in and verify his ID, and access only the user data stored in the cloud computing server, which is applicable to various security and confidential applications;
  • the cloud computing terminal hardware requirements are low, only need to configure the network module and graphics processing hardware, no need for a powerful computing unit, high-capacity memory or memory;

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

Disclosed is a cloud computing mobile terminal, comprising local hardware. The local hardware comprises a human-computer interaction device, a local memory, a communication transmission unit, and a microprocessor. The cloud computing mobile terminal further comprises: a basic system architecture for operating the local hardware, so as to implement basic communications and application functions; a cloud computing service layer for interacting with a cloud system in a remote cloud computing server, the cloud computing service layer running based on the basic system architecture, the cloud system being a user-customized system running based on a cloud computing source; and a transmission management module for managing and monitoring transmission channels between a communications port of the cloud computing service layer and the cloud computing server, the transmission channels comprising an instruction channel, an application program data channel, and a file data stream channel. Also disclosed is an operating method for the cloud computing mobile terminal.

Description

云计算移动终端及其工作方法Cloud computing mobile terminal and working method thereof
相关申请Related application
本申请主张于2017年1月11日提交的、名称为“云计算移动终端及其工作方法”的中国发明专利申请:201710021223.X的优先权。This application claims priority from Chinese Patent Application No.: 201710021223.X filed on Jan. 11, 2017, entitled "Cloud Computing Mobile Terminal and Its Working Method".
技术领域Technical field
本发明属于云计算领域和移动通信领域,具体涉及云计算移动终端及其工作方法。The invention belongs to the field of cloud computing and mobile communication, and particularly relates to a cloud computing mobile terminal and a working method thereof.
背景技术Background technique
智能移动终端,比如智能手机、平板电脑、便携电脑等,已经成为人们日常形影不离的网络终端设备。当前智能移动终端产品整机更新周期短,消费者往往平均一年就要更换新版本的移动终端产品。然而这些更新的产品通常堆叠性能参数,比如CPU运算能力、内存大小、存储容量,而其它硬件(比如显示屏、网络适配器)的更新程度较低。过于频繁的电子产品替换让消费者带来经济压力,而且不利于节能环保。而且,对于部分追求“够用主义”的用户而言,他们的智能终端往往性能过剩,造成浪费。Intelligent mobile terminals, such as smart phones, tablets, and portable computers, have become the network terminal devices that people can't keep in every day. At present, the smart phone terminal product has a short update cycle, and consumers tend to replace the new version of the mobile terminal product on average every year. However, these updated products usually stack performance parameters such as CPU computing power, memory size, and storage capacity, while other hardware (such as display screens and network adapters) are less updated. Too frequent replacement of electronic products puts economic pressure on consumers and is not conducive to energy conservation and environmental protection. Moreover, for some users who are pursuing "sufficient use", their smart terminals often have excess performance and waste.
另一方面,随着移动通信技术的日益发展,第五代移动通信技术(5G)即将商用,智能移动终端将享有更加高速便捷的网络互连环境。在5G时代,全球将会出现500亿连接的万物互联服务,人们对智能终端的计算能力以及服务质量的要求越来越高。移动云计算将成为5G网络创新服务的关键技术之一。移动云计算是一种全新的IT资源或信息服务的交付与使用模式,它是在移动互联网中引入云计算的产物。On the other hand, with the development of mobile communication technology, the fifth generation mobile communication technology (5G) is about to be commercialized, and the intelligent mobile terminal will enjoy a more high-speed and convenient network interconnection environment. In the 5G era, there will be 50 billion connected Internet of Everything services in the world, and people's computing power and quality of service requirements for intelligent terminals are getting higher and higher. Mobile cloud computing will become one of the key technologies for 5G network innovation services. Mobile cloud computing is a new mode of delivery and use of IT resources or information services. It is the product of introducing cloud computing into the mobile Internet.
在当前移动云技术中,通常采用云端服务器提供云服务,供移动终端登陆并同步数据和事件。例如在专利文献CN102377739A中公开了移动终端仅仅具有显示视频、播放声音、将用户的输入发送给云服务器的基础功能,其它功能都由云服务器提供,减小对移动终端硬件性能的依赖程度,降低移动终端的成本,利于移动终端功能的扩展和升级。但是,专利文献CN102377739A中的方案仅限于音频和视频云同步传输和解码以及相关的事件操作,应用范围局限,并且不能解决移动终端的GUI呈现和同步、云计算资源调度、媒体重定向加速等问题。而在专利文献CN103345406A中公开了云端服务器提供虚拟机运行安卓系统并模拟虚拟移动终端,然后可通过物理移动终端以类似于远程协助的方式接入其中。但是,在专利文献CN103345406A的方案中,物理移动终端仍然需要一定的配置以运行用于接入云端虚拟机的APP,而且还需要运作同样的安卓系统的复杂框架,并且其采用直接远程控制的方式需要对远程系统的桌面传屏,数据通信量庞大、速度慢、容易卡屏。In current mobile cloud technologies, cloud servers are usually provided to provide cloud services for mobile terminals to log in and synchronize data and events. For example, in the patent document CN102377739A, the mobile terminal only has the basic function of displaying video, playing sound, and transmitting the user's input to the cloud server, and other functions are provided by the cloud server, reducing the dependence on the hardware performance of the mobile terminal and reducing The cost of the mobile terminal is conducive to the expansion and upgrade of the mobile terminal function. However, the solution in the patent document CN102377739A is limited to audio and video cloud synchronous transmission and decoding and related event operations, and the application scope is limited, and the problem of GUI presentation and synchronization of the mobile terminal, cloud computing resource scheduling, media redirection acceleration, etc. cannot be solved. . In the patent document CN103345406A, it is disclosed that the cloud server provides a virtual machine to run the Android system and simulates the virtual mobile terminal, and then can be accessed by the physical mobile terminal in a manner similar to remote assistance. However, in the solution of the patent document CN103345406A, the physical mobile terminal still needs a certain configuration to run the APP for accessing the cloud virtual machine, and also needs to operate the complex framework of the same Android system, and adopts the method of direct remote control. It is necessary to screen the desktop of the remote system, and the data traffic is huge, the speed is slow, and the card screen is easy.
此外,在智能移动终端市场,还存在企业应用和安全保密服务的需求。还有用户需要使用多种操作系统或定制系统,比如某用户出差办公时使用Windows系统,通信手机使用Android系统,如果可以在同一移动终端都能使用多种操作系统,将会带来极大的便利。In addition, in the smart mobile terminal market, there is also a need for enterprise applications and security services. There are also users who need to use a variety of operating systems or custom systems. For example, if a user uses a Windows system while on a business trip, and a communication mobile phone uses an Android system, if you can use multiple operating systems on the same mobile terminal, it will bring great convenient.
发明内容Summary of the invention
本发明通过提供一种云计算移动终端及其工作方法以解决上述问题。The present invention solves the above problems by providing a cloud computing mobile terminal and a working method thereof.
本发明采用的技术方案一方面提供一种云计算移动终端,包括本地硬件,本地硬件包括人机交互设备、本地存储器、通信传输单元和微处理器。该云计算移动终端还包括:基础系统架构,用于操作所述本地硬 件,以实施基础的通信和应用功能;云计算服务层,用于与远程的云计算服务器中的云系统进行交互,所述云计算服务层基于所述基础系统架构运行,所述云系统是基于云计算资源运行的用户定制系统;以及传输管理模块,用于管理和监控所述云计算服务层的通信接口与云计算服务器之间的传输通道,该传输通道包括指令通道、应用程序数据通道和文件数据流通道。The technical solution adopted by the present invention provides a cloud computing mobile terminal, which includes local hardware, and the local hardware includes a human-machine interaction device, a local memory, a communication transmission unit, and a microprocessor. The cloud computing mobile terminal further includes: a basic system architecture for operating the local hardware to implement basic communication and application functions; and a cloud computing service layer for interacting with a cloud system in the remote cloud computing server, The cloud computing service layer operates based on the basic system architecture, the cloud system is a user customization system running based on cloud computing resources; and a transmission management module for managing and monitoring the communication interface and cloud computing of the cloud computing service layer A transmission channel between servers, which includes an instruction channel, an application data channel, and a file data stream channel.
进一步,指令通道传输由用户操作所述人机交互设备时所产生的指令和由云计算服务器发出的指令;应用程序数据通道传输应用程序运行数据,包括GUI同步刷新数据;文件数据流通道用于传输媒体文件数据或基础用户文件;其中,指令通道对网络资源的占用优先级高于应用程序数据通道,应用程序数据通道的对网络资源的占用优先级高于文件数据流通道。Further, the instruction channel transmits an instruction generated by the user operating the human-machine interaction device and an instruction issued by the cloud computing server; the application data channel transmits the application running data, including the GUI synchronization refresh data; the file data stream channel is used for The media file data or the basic user file is transmitted; wherein the command channel occupies the network resource with a higher priority than the application data channel, and the application data channel occupies the network resource with a higher priority than the file data stream channel.
进一步,所述传输管理模块还包括:一个或多个缓冲区,用于在云计算服务层的通信接口与云计算服务器之间实时交互过程中对传输通道中的实时数据进行缓冲。Further, the transmission management module further includes: one or more buffers for buffering real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server.
优选地,为指令通道分配的缓冲区的速度优先级高于其它通道,为文件数据流通道分配的缓冲区的体积大于其它通道。所述传输管理模块采用的通信协议包括TCP、HTTP、UDP或Web Socket。Preferably, the buffer allocated for the instruction channel has a higher speed priority than the other channels, and the buffer allocated for the file data stream channel is larger than the other channels. The communication protocol adopted by the transmission management module includes TCP, HTTP, UDP or Web Socket.
进一步,所述云计算服务层包括GUI管理单元,其通过应用程序数据通道,根据激活的所述云系统的GUI接口,在所述人机交互设备的显示器中生成相应的本地GUI界面,并且实时对接指令通道,实现本地和云端GUI界面的实时同步。Further, the cloud computing service layer includes a GUI management unit that generates a corresponding local GUI interface in the display of the human-machine interaction device according to the activated GUI interface of the cloud system through an application data channel, and real-time Docking command channels for real-time synchronization of local and cloud GUI interfaces.
进一步,所述云计算服务层包括多媒体处理单元,用于对云计算服务器发送的多媒体压缩数据进行解码和通过本地硬件来呈现。Further, the cloud computing service layer includes a multimedia processing unit, configured to decode multimedia compressed data sent by the cloud computing server and present by local hardware.
优选地,所述多媒体处理单元还通过调用本地硬件资源对多媒体压 缩数据进行硬解码。Preferably, the multimedia processing unit also hard decodes the multimedia compressed data by calling local hardware resources.
进一步,所述云计算移动终端还包括资源调配模块,用于调度和分配本地和/或云端的软硬件资源到所述云计算服务层。Further, the cloud computing mobile terminal further includes a resource allocation module, configured to schedule and allocate local and/or cloud hardware and software resources to the cloud computing service layer.
优选地,所述资源调配模块根据所述云计算服务层和传输管理模块的请求量和请求优先级,并且根据通信传输单元的网络吞吐,来调整所述软硬件资源的分配量。所述资源调配模块包括:内存融合单元,用于通过云计算服务器融合其它云计算设备的内存资源;存储融合单元,用于通过云计算服务器融合其它云计算设备的存储资源。Preferably, the resource allocation module adjusts the allocation amount of the software and hardware resources according to the request amount and the request priority of the cloud computing service layer and the transmission management module, and according to network throughput of the communication transmission unit. The resource allocation module includes: a memory fusion unit, configured to fuse memory resources of other cloud computing devices by using a cloud computing server; and a storage fusion unit, configured to integrate storage resources of other cloud computing devices by using a cloud computing server.
进一步,所述基础系统架构包括本地应用服务层,用于提供基础的本地应用程序运行环境;所述本地应用服务层与云计算服务器中的云系统的应用服务层同步。其中所述基础系统架构包括Android架构、Windows架构、Unix架构。其中所述通信传输单元包括移动通信模块,其中所述移动通信模块包括2G、3G、4G和/或5G网络通信模式。其中所述通信传输单元还包括Wi-Fi通信模块、蓝牙通信模块和/或近场通信模块。Further, the basic system architecture includes a local application service layer for providing a basic local application running environment; the local application service layer is synchronized with an application service layer of the cloud system in the cloud computing server. The basic system architecture includes an Android architecture, a Windows architecture, and a Unix architecture. Wherein the communication transmission unit comprises a mobile communication module, wherein the mobile communication module comprises a 2G, 3G, 4G and/or 5G network communication mode. The communication transmission unit further includes a Wi-Fi communication module, a Bluetooth communication module, and/or a near field communication module.
进一步,其中所述本地硬件还包括用于多媒体处理的专用硬解码器。Further, wherein the local hardware further includes a dedicated hard decoder for multimedia processing.
本发明另一方面提供一种云计算移动终端工作方法,包括以下步骤:A、验证用户请求,接入云计算服务器;B、接收基于云计算资源运行的用户定制的云系统的GUI数据和应用程序数据,生成本地GUI界面和关联相应的本地应用程序服务;C、捕捉本地硬件接收到的用户动作以及采集云计算移动终端的状态参数,转换为用户指令和应用程序操作数据,然后发送到云计算服务器;D、接收更新的云系统的GUI数据和应用程序数据,更新本地GUI界面且同步相应的本地应用程序服务;E、判断用户是否发出退出指令,是则退出云计算服务,否则返回步骤C。Another aspect of the present invention provides a method for operating a cloud computing mobile terminal, including the following steps: A, verifying a user request, accessing a cloud computing server; B, receiving GUI data and application of a customized cloud system running based on the cloud computing resource Program data, generating a local GUI interface and associating corresponding local application services; C, capturing user actions received by the local hardware, and collecting state parameters of the cloud computing mobile terminal, converting to user instructions and application operation data, and then transmitting to the cloud Computing server; D, receiving GUI data and application data of the updated cloud system, updating the local GUI interface and synchronizing the corresponding local application service; E, determining whether the user issues an exit instruction, exiting the cloud computing service, otherwise returning to the step C.
优选地,所述工作方法,还包括:管理和监控云计算移动终端的通信接口与云计算服务器之间的指令通道、应用程序数据通道和文件数据 流通道,实现实时通信;调度和分配本地和/或云端的软硬件资源,以在本地优化云计算服务运行。Preferably, the working method further includes: managing and monitoring an instruction channel, an application data channel, and a file data flow channel between the communication interface of the cloud computing mobile terminal and the cloud computing server, to implement real-time communication; scheduling and allocating local and / or cloud hardware and software resources to optimize the cloud computing service to run locally.
本发明第三方面还提供一种计算装置,包括储存器和处理器,其中,所述处理器执行储存于所述存储器中的程序命令,以执行上述工作方法的步骤。A third aspect of the present invention also provides a computing device comprising a storage and a processor, wherein the processor executes program commands stored in the memory to perform the steps of the working method described above.
本发明的有益效果为:提出了云计算终端,填补了该领域的技术空白;延长了移动终端的硬件替换周期,满足用户在同一终端使用定制系统和各种系统的需求;提供云计算移动终端和服务器之间的资源调配和调度,调动闲置资源来实现整合和共享。The invention has the beneficial effects that the cloud computing terminal is proposed, which fills the technical blank in the field, extends the hardware replacement period of the mobile terminal, satisfies the needs of the user to use the customized system and various systems in the same terminal, and provides the cloud computing mobile terminal. Resource provisioning and scheduling with the server to mobilize idle resources for integration and sharing.
附图说明DRAWINGS
图1所示为根据发明的云计算移动终端的应用示意图;1 is a schematic diagram of an application of a cloud computing mobile terminal according to the present invention;
图2所示为根据发明的云计算移动终端的框图,还示出了云计算服务器的示意性框图;2 is a block diagram of a cloud computing mobile terminal according to the invention, and also shows a schematic block diagram of a cloud computing server;
图3所示为根据发明的云计算移动终端的工作流程图,还示出了云计算服务器的协作工作流程图;3 is a flowchart showing the operation of a cloud computing mobile terminal according to the invention, and also showing a collaborative working flowchart of the cloud computing server;
图4所示为根据发明的云计算移动终端的工作过程中的传输管理流程图;4 is a flow chart showing the transmission management during the working process of the cloud computing mobile terminal according to the present invention;
图5所示为根据发明的云计算移动终端的工作过程中的多媒体重定向处理流程图。FIG. 5 is a flow chart showing a multimedia redirection process in the working process of a cloud computing mobile terminal according to the present invention.
具体实施方式detailed description
图1所示为根据本发明的云计算移动终端的应用示意图,其中示出了云计算移动终端1与云计算服务器2通过通信设备3联网,所采用的联网方式可以是有线连接、无线连接、或者其任意组合。具体地,在云 计算移动终端1与云计算服务器2之间可以采用移动通信连接(比如,2G、3G、4G或5G通信方式)、广域网或以太网等技术来组网。应理解到,云计算移动终端1、云计算服务器2和通信设备3分别在数量上可以是多个。云计算服务器2包括多处理器系统、小型计算机、大型计算机、分布式计算系统、集群计算系统等。通信设备3包括网络适配器、网络交换机、路由器、调制解调器、光纤/双绞线线路、无线AP、天线、移动通信基站等。1 is a schematic diagram of an application of a cloud computing mobile terminal according to the present invention, wherein the cloud computing mobile terminal 1 and the cloud computing server 2 are networked through the communication device 3, and the networking manner adopted may be a wired connection, a wireless connection, or Or any combination thereof. Specifically, between the cloud computing mobile terminal 1 and the cloud computing server 2, a mobile communication connection (for example, 2G, 3G, 4G, or 5G communication mode), a wide area network, or an Ethernet network may be used for networking. It should be understood that the cloud computing mobile terminal 1, the cloud computing server 2, and the communication device 3 may each be plural in number. The cloud computing server 2 includes a multiprocessor system, a small computer, a mainframe computer, a distributed computing system, a cluster computing system, and the like. The communication device 3 includes a network adapter, a network switch, a router, a modem, an optical fiber/twisted pair line, a wireless AP, an antenna, a mobile communication base station, and the like.
参照图2,云计算服务器2可以包括云集群架构21、网络管理器22、处理器23、调度器24、存储器25等。云集群架构21融合云终端资源为多组云系统提供运行环境,每组云系统内部按顺序模拟运行多个云系统,所述云系统通过网络管理器22处理相应的云计算移动终端1的通信以提供云计算服务。处理器23可根据云计算服务器当前运行情况,促使调度器24从云集群网络中的各种云计算设备或者从云计算移动终端调度资源。在一个实例中,当云计算服务器2存储容量紧张时,处理器23可以分析云集群网络中的与云计算服务器2连接的闲置NAS(Network Attached Storage,网络附属存储)资源,通过调度器24将该NAS的可用存储内容并址到存储器25中,供云计算服务器2内部使用或者供一个或多个云计算移动终端1使用。在另一个实例中,当云计算服务器2的内存容量紧张时,处理器23可以分析与云计算服务器2连接的云计算移动终端1的闲置内存资源,通过调度器24将该云计算移动终端1的可用闲置内存资源整合到云计算服务器2中的内存池中。Referring to FIG. 2, the cloud computing server 2 may include a cloud cluster architecture 21, a network manager 22, a processor 23, a scheduler 24, a memory 25, and the like. The cloud cluster architecture 21 integrates the cloud terminal resources to provide an operating environment for the plurality of cloud systems, and each cloud system internally simulates running multiple cloud systems in sequence, and the cloud system processes the corresponding cloud computing mobile terminal 1 communication through the network manager 22. To provide cloud computing services. The processor 23 may cause the scheduler 24 to schedule resources from various cloud computing devices in the cloud cluster network or from cloud computing mobile terminals according to the current operating conditions of the cloud computing server. In an example, when the storage capacity of the cloud computing server 2 is tight, the processor 23 can analyze the idle NAS (Network Attached Storage) resources connected to the cloud computing server 2 in the cloud cluster network, and the scheduler 24 The available storage content of the NAS is addressed to the memory 25 for internal use by the cloud computing server 2 or for use by one or more cloud computing mobile terminals 1. In another example, when the memory capacity of the cloud computing server 2 is tight, the processor 23 may analyze the idle memory resource of the cloud computing mobile terminal 1 connected to the cloud computing server 2, and the cloud computing mobile terminal 1 is configured by the scheduler 24. The available idle memory resources are integrated into the memory pool in the cloud computing server 2.
在根据本发明的实施例中,云计算移动终端1运行一操作系统,该操作系统可以在基础模式和云计算模式之间切换。在操作系统的基础模式下,在云计算移动终端1中可以仅运行基本的通信功能(比如,通话、收发短信、FM收音)和应用程序(APP)(比如,记事本、计算器、离线 地图);在其云模式下,云计算移动终端1可以通过网络,比如优选地通过高速的5G网络,与云计算服务器2中运行的云系统交互,载入云系统的丰富硬件资源和调用运行于云系统的APP。例如,当用户操作交互设备150完成登陆验证后,云计算移动终端1连接至云计算服务器2中模拟运行的对应云系统,使移动终端1的用户界面(UI)从通话输入页面10切换至APP功能页面10’,继而使云计算移动终端1的UI与云系统的拟生成界面10”同步。值得注意的是,模拟运行的云系统实际上不需要显示出UI图形,因此图1中仅以云系统的拟生成界面10”作为示意性的描述。In an embodiment in accordance with the invention, the cloud computing mobile terminal 1 runs an operating system that can switch between a base mode and a cloud computing mode. In the basic mode of the operating system, only basic communication functions (such as calling, sending and receiving text messages, FM radio) and applications (APP) can be run in the cloud computing mobile terminal 1 (for example, notepad, calculator, offline map) In its cloud mode, the cloud computing mobile terminal 1 can interact with the cloud system running in the cloud computing server 2 through a network, such as preferably through a high-speed 5G network, and load the rich hardware resources of the cloud system and call the operation. Cloud system app. For example, after the user operates the interactive device 150 to complete the login verification, the cloud computing mobile terminal 1 is connected to the corresponding cloud system simulated in the cloud computing server 2, and the user interface (UI) of the mobile terminal 1 is switched from the call input page 10 to the APP. The function page 10', in turn, synchronizes the UI of the cloud computing mobile terminal 1 with the pseudo-generation interface 10" of the cloud system. It is worth noting that the cloud system that simulates running does not actually need to display the UI graphics, so only FIG. The pseudo-generated interface 10" of the cloud system is taken as a schematic description.
下面在各种实施中进一步描述根据本发明的云计算移动终端1的结构和工作流程。The structure and workflow of the cloud computing mobile terminal 1 according to the present invention are further described below in various implementations.
参照图2所示的云计算移动终端1的框图。云计算移动终端1的本地硬件包括人机交互设备150、微处理器153、解码器154、存储器155、通信传输单元156等。优选地,人机交互设备150可以包括触摸屏151和指纹器152。Referring to the block diagram of the cloud computing mobile terminal 1 shown in FIG. The local hardware of the cloud computing mobile terminal 1 includes a human-machine interaction device 150, a microprocessor 153, a decoder 154, a memory 155, a communication transmission unit 156, and the like. Preferably, the human-machine interaction device 150 may include a touch screen 151 and a fingerprint device 152.
在一些实施例中,人机交互设备150还可以包括:一个或多个输入设备,例如键盘、鼠标、笔、语音输入设备、触摸输入设备、红外摄像头、视频输入设备等;以及一个或多个输出设备,例如是一个或多个显示器、扬声器、投影仪、振动反馈器等。输入设备和输出设备可通过有线连接、无线连接、或者其任意组合,连接至云计算移动终端1。在一实施方式中,来自另一移动终端的输入设备或输出设备可用作当前移动终端的输入或输出设备。In some embodiments, the human-machine interaction device 150 may further include: one or more input devices, such as a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, etc.; and one or more The output device is, for example, one or more displays, speakers, projectors, vibration feedback devices, and the like. The input device and the output device can be connected to the cloud computing mobile terminal 1 through a wired connection, a wireless connection, or any combination thereof. In an embodiment, an input device or output device from another mobile terminal can be used as an input or output device of the current mobile terminal.
解码器154用于将数字视音频数据流解码还原成模拟视音频信号。优选地,解码器154可以是专门的硬件解码芯片,也可以是集成在微处理器153中的解码处理单元。云计算移动终端1还可以包括编码器,用 于将模拟视音频信号压缩为数据编码文件。The decoder 154 is for decoding the digital video and audio data stream to an analog video and audio signal. Preferably, the decoder 154 may be a dedicated hardware decoding chip or a decoding processing unit integrated in the microprocessor 153. The cloud computing mobile terminal 1 may further include an encoder for compressing the analog video and audio signals into data encoded files.
在云计算移动终端1和云计算服务器2中的存储器155、25一般采用计算机存储介质。该计算机存储介质包括应用于任何方法或技术,以存储例如计算机可读指令或其他数据的信息的易失性的和非易失性的、可移动的和非可移动的介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪速存储器或其他存储技术、CD-ROM、数字影碟(DVD)或其他光存储设备、或者任何其他能够用于存储所需信息并由相应设备访问的介质。此处的传输介质通常具体储存计算机可读指令或其他以“调制数据信号”形式的数据,例如载波或其他传输方式,并且包括任何信息传输媒介。The memories 155, 25 in the cloud computing mobile terminal 1 and the cloud computing server 2 generally employ computer storage media. The computer storage medium includes volatile and nonvolatile, removable and non-removable media that are applied to any method or technology to store information such as computer readable instructions or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital video disc (DVD) or other optical storage device, or any other device capable of storing the required information and by the corresponding device Media accessed. The transmission medium herein typically stores computer readable instructions or other data in the form of "modulated data signals", such as carrier waves or other transmissions, and includes any information transmission medium.
云计算移动终端1的通信传输单元156包括移动通信模块,其中所述移动通信模块包括2G、3G、4G和5G网络通信模式中的任意一种或多种。所述通信传输单元156还包括Wi-Fi通信模块、蓝牙通信模块和/或近场通信模块。在其他实施例中,通信传输单元156可以包括一个或多个通信连接元件,其允许移动终端1与其他设备通讯,进一步,通信连接元件还可以包括但不限于调制解调器、射频发射器/接收器、红外端口、USB连接器或其他接口。The communication transmission unit 156 of the cloud computing mobile terminal 1 includes a mobile communication module, wherein the mobile communication module includes any one or more of 2G, 3G, 4G, and 5G network communication modes. The communication transmission unit 156 also includes a Wi-Fi communication module, a Bluetooth communication module, and/or a near field communication module. In other embodiments, communication transmission unit 156 may include one or more communication connection elements that allow mobile terminal 1 to communicate with other devices. Further, communication connection elements may also include, but are not limited to, a modem, a radio frequency transmitter/receiver, Infrared port, USB connector or other interface.
基于硬件资源,云计算移动终端1还包括基础的操作系统架构12、云计算服务层11以及传输管理模块13。在本实施例中,基于所述基础系统架构12运行的云计算服务层11通过传输管理模块13与远程的云计算服务器2中关联的云系统进行交互,下面进一步描述。Based on the hardware resources, the cloud computing mobile terminal 1 further includes a basic operating system architecture 12, a cloud computing service layer 11, and a transmission management module 13. In the present embodiment, the cloud computing service layer 11 running based on the base system architecture 12 interacts with the cloud system associated with the remote cloud computing server 2 through the transport management module 13, as described further below.
基础系统架构12用于操作本地硬件以实施基础的通信功能和运行基础的应用程序。具体地,基础系统架构12包括内核层、系统核心库和应用层。其中,内核层提供核心的系统服务,如安全功能、内存管理、进程管理、硬件驱动等;系统核心库提供了专门为云计算移动终端1的硬 件定制的系统函数库功能,同时也包含了一些核心的应用程序编程接口(API);应用层包含多个应用程序,如SMS短信客户端程序、电话拨号程序、图片浏览器、Web浏览器等。在优选的实施例中,该系统架构可以基于基础嵌入式系统(比如,Linux、Unix、WinCE等)的架构进行开发,还可以直接基于开源移动嵌入式系统(比如Andriod)的架构进行修改。The base system architecture 12 is used to operate local hardware to implement basic communication functions and applications that run the foundation. Specifically, the base system architecture 12 includes a kernel layer, a system core library, and an application layer. The kernel layer provides core system services, such as security functions, memory management, process management, hardware drivers, etc.; the system core library provides system function library functions customized for the hardware of the cloud computing mobile terminal 1, and also includes some The core application programming interface (API); the application layer contains multiple applications, such as SMS SMS client program, phone dialer, picture browser, web browser and so on. In a preferred embodiment, the system architecture can be developed based on the architecture of the underlying embedded system (eg, Linux, Unix, WinCE, etc.), and can be modified directly based on the architecture of an open source mobile embedded system (such as Andriod).
传输管理模块13用于管理和监控所述云计算服务层的通信接口与云计算服务器之间的传输通道,该传输通道包括指令通道、应用程序数据通道和文件数据流通道。指令通道传输由用户操作所述人机交互设备时所产生的指令和由云计算服务器发出的指令;应用程序数据通道传输应用程序运行数据,包括GUI同步刷新数据;文件数据流通道用于传输媒体文件数据或基本用户文件;其中,指令通道对网络资源的占用优先级高于应用程序数据通道,应用程序数据通道的对网络资源的占用优先级高于文件数据流通道。传输管理模块还可以基于加密协议(如SSL、TLS等)提供通信加密手段。所述传输管理模块13还包括:一个或多个缓冲区,用于在云计算服务层的通信接口与云计算服务器之间实时交互过程中对传输通道中的实时数据进行缓冲。为指令通道分配的缓冲区的速度优先级高于其它通道,为文件数据流通道分配的缓冲区的体积大于其它通道。所述传输管理模块采用的通信协议包括TCP、HTTP、UDP或Web Socket。The transmission management module 13 is configured to manage and monitor a transmission channel between the communication interface of the cloud computing service layer and the cloud computing server, where the transmission channel includes an instruction channel, an application data channel, and a file data stream channel. The instruction channel transmits instructions generated by the user when operating the human-machine interaction device and instructions issued by the cloud computing server; the application data channel transmits application running data, including GUI synchronous refresh data; and the file data stream channel is used for transmitting media The file data or the basic user file; wherein the command channel occupies the network resource with a higher priority than the application data channel, and the application data channel occupies the network resource with a higher priority than the file data stream channel. The transport management module can also provide communication encryption means based on encryption protocols such as SSL, TLS, and the like. The transmission management module 13 further includes: one or more buffers for buffering real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server. The buffer allocated for the instruction channel has a higher speed priority than the other channels, and the buffer allocated for the file data stream channel is larger than the other channels. The communication protocol adopted by the transmission management module includes TCP, HTTP, UDP or Web Socket.
云计算服务层11运行一套云计算功能支持组件,该组件包括安全验证单元、GUI管理单元、多媒体处理单元、云同步监控单元和后台管理单元。The cloud computing service layer 11 runs a set of cloud computing function support components, including a security verification unit, a GUI management unit, a multimedia processing unit, a cloud synchronization monitoring unit, and a background management unit.
安全验证单元可以用于验证云计算移动终端的用户身份,比如通过验证用户通过触摸屏151输入的账户和密码,或者用户通过指纹器152输入的指纹,来登陆云计算移动终端1的操作系统和/或接入云计算服务 器2中的用户账户。The security verification unit may be used to verify the user identity of the cloud computing mobile terminal, such as by verifying the account and password entered by the user through the touch screen 151, or the fingerprint input by the user through the fingerprint device 152, to log in to the operating system of the cloud computing mobile terminal 1 and/or Or access the user account in the cloud computing server 2.
GUI管理单元可以用于生成默认界面,如APP功能页面10’,然后在人机交互设备150的显示屏中显示相应的本地GUI界面。GUI管理单元还用于实时对接本地且云计算服务器的指令通道,实现本地终端和云系统端GUI界面的实时同步。优选地,GUI管理单元通过应用程序数据通道,根据激活的所述云系统的GUI接口,在所述人机交互设备的显示器中显示相应的本地GUI界面,并且实时对接指令通道,优先生成本地GUI界面,然后同步本地GUI界面和云端GUI界面。例如,一旦用户操作触摸屏151点击在APP功能页面10’中的社交APP的图标,GUI管理单元立即利用该社交APP的缓存数据(如,好友页面数据),在本地预生成一个显示聊天好友的目标界面和缓存的好友在线状态标识;由于用户的点击操作指令已经通过所述指令通道传输到云计算服务器2中,触发相应的云系统解析点击动作,然后由云计算服务器2返回更新的GUI数据到GUI管理单元,在已经预生成的目标界面小幅度进行更新同步,比如更新聊天好友的在线状态标识。这样的GUI更新方式比传统的基于远程协助的界面传输方式(参见专利文献CN103345406A)速度更快,效率更高,而且还显著提高了界面流畅度和用户实时操作体验。The GUI management unit can be used to generate a default interface, such as the APP function page 10', and then display the corresponding local GUI interface in the display of the human interface device 150. The GUI management unit is also used for real-time docking of local and cloud computing server instruction channels to realize real-time synchronization of the local terminal and the cloud system side GUI interface. Preferably, the GUI management unit displays a corresponding local GUI interface in the display of the human-machine interaction device according to the activated GUI interface of the cloud system through the application data channel, and directly connects the instruction channel in real time, and preferentially generates a local GUI. Interface, then synchronize the local GUI interface and the cloud GUI interface. For example, once the user operates the touch screen 151 to click the icon of the social APP in the APP function page 10', the GUI management unit immediately uses the cached data of the social APP (eg, friend page data) to locally generate a target for displaying the chat friend locally. The interface and the cached friend online status identifier; since the user's click operation instruction has been transmitted to the cloud computing server 2 through the instruction channel, triggering the corresponding cloud system to resolve the click action, and then the cloud computing server 2 returns the updated GUI data to The GUI management unit performs update synchronization in a small amount on the target interface that has been pre-generated, such as updating the online status identifier of the chat friend. Such a GUI update method is faster and more efficient than the traditional remote assistance-based interface transfer method (see Patent Document CN103345406A), and also significantly improves the interface fluency and the user's real-time operating experience.
多媒体处理单元,用于对云计算服务器发送的多媒体压缩数据进行解码和通过本地硬件来呈现。具体地,多媒体处理单元呈现媒体的方式有两种:1)服务端渲染,即是在云系统中对视频音频文件进行前期编解码、渲染后,由多媒体处理单元接收图像进行显示;2)多媒体重定向,也可以称为移动端渲染,视频音频文件是经过分片、打包,由多媒体处理单元通过调用本地硬件资源对多媒体压缩数据进行软解码或直接的硬解码。优选地,在上述方法中采用多媒体重定向功能在本地移动终端和云端都支持同时启用,比如在云计算移动终端录制的视频和音频,可以 经过多媒体处理单元编码压缩,然后传输到云系统中进行重定向解码和播放。上述两种方式各有优缺点:对于方式1),可以利用云计算服务器2的强大运算资源进行解码和渲染,但是传输的图像和音频数据对网络要求高;对于方式2),可以提高云系统乃至整个云计算服务器的视频并发密度,利用移动端的显示芯片,提高了视频的画质和流畅度,节约带宽资源,但是也会增加云计算移动终端的负担。在一个优选的实施例中,多媒体处理单元可以根据网络情况、剩余电量等参数来切换上述方式,比如当云计算移动终端接入稳定的WiFi网络时可以采用方式1,当云计算移动终端接入网络且剩余电量充裕时可以采用方式2。And a multimedia processing unit, configured to decode the multimedia compressed data sent by the cloud computing server and present by using local hardware. Specifically, there are two ways for the multimedia processing unit to present the media: 1) server-side rendering, that is, after the video/audio file is pre-coded and decoded in the cloud system, the multimedia processing unit receives the image for display; 2) multimedia Redirection, also known as mobile rendering, video audio files are fragmented and packaged, and the multimedia processing unit soft decodes or directly hard decodes the multimedia compressed data by calling local hardware resources. Preferably, the multimedia redirection function is used in the above method to enable simultaneous activation of both the local mobile terminal and the cloud, for example, the video and audio recorded in the cloud computing mobile terminal can be encoded and compressed by the multimedia processing unit, and then transmitted to the cloud system for transmission. Redirect decoding and playback. The above two methods have their own advantages and disadvantages: for the mode 1), the powerful computing resources of the cloud computing server 2 can be used for decoding and rendering, but the transmitted image and audio data have high requirements on the network; for the mode 2), the cloud system can be improved. Even the video concurrency density of the entire cloud computing server, using the display chip of the mobile terminal, improves the picture quality and smoothness of the video, saves bandwidth resources, but also increases the burden of the cloud computing mobile terminal. In a preferred embodiment, the multimedia processing unit may switch the foregoing manner according to parameters such as network conditions, remaining power, and the like. For example, when the cloud computing mobile terminal accesses a stable WiFi network, mode 1 may be adopted, when the cloud computing mobile terminal accesses Mode 2 can be used when the network is full and the remaining power is sufficient.
优选地,所述云计算移动终端1还包括资源调配模块14,用于调度和分配本地和/或云端的软硬件资源到所述云计算服务层。资源调配模块14根据所述云计算服务层和传输管理模块的请求量和请求优先级,并且根据通信传输单元的网络吞吐,来调整所述软硬件资源的分配量。所述资源调配模块包括:内存融合单元,用于通过云计算服务器2的调度器24融合其它云计算设备的内存资源;存储融合单元,用于通过云计算服务器融合其它云计算设备的存储资源。云计算设备可以包括与云计算服务器2的分布式远程分机或者已接入云计算服务器2的另一云计算移动终端。这样一来,每个云计算移动终端1可以调用整个云平台网络中的远程分机的闲置资源(比如,内存、存储资源),并整合到本地主机作为本地资源的扩展,使得本地主机无需升级硬件的情况下使用更多的外部整合资源。Preferably, the cloud computing mobile terminal 1 further includes a resource allocation module 14 for scheduling and distributing local and/or cloud hardware and software resources to the cloud computing service layer. The resource allocation module 14 adjusts the allocation amount of the software and hardware resources according to the request amount and the request priority of the cloud computing service layer and the transmission management module, and according to the network throughput of the communication transmission unit. The resource allocation module includes: a memory fusion unit, configured to fuse memory resources of other cloud computing devices by the scheduler 24 of the cloud computing server 2; and a storage fusion unit configured to fuse storage resources of other cloud computing devices by the cloud computing server. The cloud computing device can include a distributed remote extension with the cloud computing server 2 or another cloud computing mobile terminal that has accessed the cloud computing server 2. In this way, each cloud computing mobile terminal 1 can call idle resources (such as memory and storage resources) of remote extensions in the entire cloud platform network, and integrates them into the local host as an extension of local resources, so that the local host does not need to upgrade hardware. Use more external integration resources in the case.
图3为所示为根据发明的云计算移动终端1的工作流程图。在图3中也示出了云计算服务器2的同步协助工作流程图。FIG. 3 is a flow chart showing the operation of the cloud computing mobile terminal 1 according to the present invention. A flowchart of the synchronization assistance work of the cloud computing server 2 is also shown in FIG.
在一个实施例中,根据本发明的云计算移动终端1工作方法,包括以下步骤:In one embodiment, a method for operating a cloud computing mobile terminal 1 according to the present invention includes the following steps:
S101、验证用户请求,接入云计算服务器2,选取要使用的云系统;S101. Verify the user request, access the cloud computing server 2, and select a cloud system to be used.
S102、接收基于云计算资源运行的用户定制的云系统的GUI数据和应用程序数据,生成本地GUI界面和关联相应的本地应用程序服务;S102. Receive GUI data and application data of a user-customized cloud system running based on the cloud computing resource, generate a local GUI interface, and associate a corresponding local application service.
S103、捕捉本地硬件接收到的用户动作以及采集云计算移动终端1的状态参数,转换为用户指令和应用程序操作数据,然后发送到云计算服务器;S103. Capture user actions received by the local hardware and collect state parameters of the cloud computing mobile terminal 1, convert the data into user instructions and application operation data, and then send the data to the cloud computing server.
S104、接收更新的云系统的GUI数据和应用程序数据,更新本地GUI界面且同步相应的本地应用程序服务;S104. Receive GUI data and application data of the updated cloud system, update the local GUI interface, and synchronize the corresponding local application service.
S105、S106、判断用户是否发出退出指令,是则退出云计算服务然后切换本地基础系统界面,否则返回步骤S103。S105. S106. Determine whether the user issues an exit instruction, and then exit the cloud computing service and then switch the local basic system interface, otherwise return to step S103.
相应地,云计算服务器2的工作方法包括以下步骤:Correspondingly, the working method of the cloud computing server 2 includes the following steps:
S201、根据用户注册的服务,预分配云系统资源用于运行云系统,可选地预先加载运行用户上次登陆的云系统或者用户默认登陆的云系统;S201. Pre-allocate the cloud system resource for running the cloud system according to the service registered by the user, optionally preloading the cloud system that the user last logged in or the cloud system that the user logs in by default;
S202、激活用户当前所选的云系统;S202. Activate a cloud system currently selected by the user.
S203、发送基于云计算资源运行的用户定制的云系统的GUI数据和应用程序数据;S203. Send GUI data and application data of a user-customized cloud system running based on the cloud computing resource;
S204、根据用户指令和终端参数,运行更新相应的程序和功能;S204. Run and update the corresponding program and function according to the user instruction and the terminal parameter.
S205、更新数据,打包GUI和APP数据文件,并且发送至云计算移动终端1;S205, update data, package GUI and APP data files, and send to the cloud computing mobile terminal 1;
S206、S207、判断用户是否发出退出指令,是则保存和备份用户数据,否则返回步骤S203。S206, S207, determining whether the user issues an exit instruction, and saving and backing up the user data, otherwise returning to step S203.
如图4所示,在一个具体的实施例中,在步骤S102至S104期间,在云计算移动终端1中还运行传输管理进程,包括以下步骤:As shown in FIG. 4, in a specific embodiment, during the steps S102 to S104, the transmission management process is also run in the cloud computing mobile terminal 1, including the following steps:
S301、监控所述云计算服务层的通信接口与云计算服务器之间的指 令通道、应用程序数据通道和文件数据流通道;S301. Monitor an instruction channel, an application data channel, and a file data flow channel between the communication interface of the cloud computing service layer and the cloud computing server.
S302、在分配网络资源时,使指令通道对网络资源的占用优先级高于应用程序数据通道,且应用程序数据通道的对网络资源的占用优先级高于文件数据流通道;S302. When the network resource is allocated, the priority of the command channel for the network resource is higher than the application data channel, and the application data channel has a higher priority for the network resource than the file data stream channel;
S303、在云计算服务层的通信接口与云计算服务器之间实时交互过程中对传输通道中的实时数据进行缓冲,配置指令通道的缓冲区的速度优先级高于其它通道,并且配置文件数据流通道的缓冲区的体积大于其它通道。S303. The real-time data in the transmission channel is buffered during a real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server, and the buffer of the configuration command channel has a higher speed priority than other channels, and the configuration file data flows. The volume of the track buffer is larger than the other channels.
由此,可以通过应用程序数据通道,根据激活的所述云系统的GUI接口,驱动人机交互设备的显示器中显示相应的本地GUI界面,实时对接指令通道,优先生成本地GUI界面,同步本地GUI界面和云端GUI界面。Thereby, the corresponding local GUI interface can be displayed in the display of the driven human-machine interaction device through the GUI channel of the activated application system, the real-time docking instruction channel is generated, the local GUI interface is preferentially generated, and the local GUI is synchronized. Interface and cloud GUI interface.
如图5所示,在另一个具体的实施例中,在步骤S102至S104期间,在云计算移动终端1中还并行地运行多媒体重定向处理流程,包括以下步骤:As shown in FIG. 5, in another specific embodiment, during steps S102 to S104, the multimedia redirection processing flow is also run in parallel in the cloud computing mobile terminal 1, including the following steps:
S401、对云计算服务器2发送的视频音频压缩文件进行分片或打包,S401. Perform a fragmentation or packaging on the video and audio compressed file sent by the cloud computing server 2,
S402、调用本地硬件资源对多媒体压缩数据进行软解码或直接的硬解码。S402. Call local hardware resources to perform soft decoding or direct hard decoding on the multimedia compressed data.
S403、对于云计算移动终端1录制的视频和音频,经过编码压缩,然后传输到云系统中进行重定向解码和播放。S403. The video and audio recorded by the cloud computing mobile terminal 1 are encoded and compressed, and then transmitted to the cloud system for redirected decoding and playing.
以上所述只是本发明的较佳实施例而已,本发明并不局限于上述实施方式,只要其以相同的手段达到本发明的技术效果,都应属于本发明的保护范围。在本发明的保护范围内其技术方案和/或实施方式可以有各种不同的修改和变化。本领域技术人员可以理解到本发明的技术改进包括但不限于:The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above-described embodiments, and as long as the technical effects of the present invention are achieved by the same means, it should fall within the scope of protection of the present invention. Various modifications and changes may be made to the technical solutions and/or embodiments within the scope of the invention. Those skilled in the art will appreciate that the technical improvements of the present invention include, but are not limited to:
1、运行基础系统的移动终端依赖云计算服务即可实现丰富的用户功能,还融合了云计算网络的资源;1. The mobile terminal running the basic system can realize rich user functions by relying on the cloud computing service, and also integrates the resources of the cloud computing network;
2、用户只要使用任意的云计算移动终端登陆验证自己的ID,访问只储存在云计算服务器中用户数据,适用各种安全保密应用场合;2. The user only needs to use any cloud computing mobile terminal to log in and verify his ID, and access only the user data stored in the cloud computing server, which is applicable to various security and confidential applications;
3、云计算终端的硬件要求低,只需一定配置的网络模块和图形处理硬件,无需强大的运算器、高容量的内存或存储器;3, the cloud computing terminal hardware requirements are low, only need to configure the network module and graphics processing hardware, no need for a powerful computing unit, high-capacity memory or memory;
4、利用多个传输通道的资源优化配置以及视频重定向方案,提升用户远程操作的实时响应体验。4. Optimize the real-time response experience of remote operation of users by utilizing resource optimization configuration and video redirection scheme of multiple transmission channels.
虽然上面结合本发明的优选实施例对本发明的原理进行了详细的描述,本领域技术人员应该理解,上述实施例仅仅是对本发明的示意性实现方式的解释,并非对本发明包含范围的限定。实施例中的细节并不构成对本发明范围的限制,在不背离本发明的精神和范围的情况下,任何基于本发明技术方案的等效变换、简单替换等显而易见的改变,均落在本发明保护范围之内。While the principles of the present invention have been described in detail, the preferred embodiments of the present invention The details of the embodiments are not intended to limit the scope of the invention, and any obvious changes, such as equivalent transformations, simple substitutions, etc., based on the technical solutions of the present invention, fall within the scope of the present invention. Within the scope of protection.

Claims (20)

  1. 一种云计算移动终端,其特征在于,包括:A cloud computing mobile terminal, comprising:
    本地硬件,本地硬件包括人机交互设备、本地存储器、通信传输单元和微处理器;Local hardware, including local human-computer interaction devices, local storage, communication transmission units, and microprocessors;
    基础系统架构,用于操作所述本地硬件,以实施基础的通信和应用功能;a base system architecture for operating the local hardware to implement basic communication and application functions;
    云计算服务层,用于与远程的云计算服务器中的云系统进行交互,所述云计算服务层基于所述基础系统架构运行,所述云系统是基于云计算资源运行的用户定制系统;以及a cloud computing service layer for interacting with a cloud system in a remote cloud computing server, the cloud computing service layer operating based on the base system architecture, the cloud system being a user customized system running based on cloud computing resources;
    传输管理模块,用于管理和监控所述云计算服务层的通信接口与云计算服务器之间的传输通道,该传输通道包括指令通道、应用程序数据通道和文件数据流通道。And a transmission management module, configured to manage and monitor a transmission channel between the communication interface of the cloud computing service layer and the cloud computing server, where the transmission channel includes an instruction channel, an application data channel, and a file data stream channel.
  2. 根据权利要求1所述的云计算移动终端,其中:The cloud computing mobile terminal of claim 1 wherein:
    指令通道传输由用户操作所述人机交互设备时所产生的指令和由云计算服务器发出的指令;The instruction channel transmits an instruction generated by the user to operate the human-machine interaction device and an instruction issued by the cloud computing server;
    应用程序数据通道传输应用程序运行数据,包括GUI同步刷新数据;The application data channel transmits the application running data, including the GUI synchronization refresh data;
    文件数据流通道用于传输媒体流文件数据或基本用户文件;The file data stream channel is used to transmit media stream file data or basic user files;
    其中,指令通道对网络资源的占用优先级高于应用程序数据通道,应用程序数据通道的对网络资源的占用优先级高于文件数据流通道。The priority of the command channel for the network resource is higher than that of the application data channel, and the application data channel has a higher priority for the network resource than the file data stream channel.
  3. 根据权利要求1所述的云计算移动终端,其中所述传输管理模块还包括:The cloud computing mobile terminal of claim 1, wherein the transmission management module further comprises:
    一个或多个缓冲区,用于在云计算服务层的通信接口与云计算服务器之间实时交互过程中对传输通道中的实时数据进行缓冲。One or more buffers for buffering real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server.
  4. 根据权利要求3所述的云计算移动终端,其中:The cloud computing mobile terminal of claim 3 wherein:
    为指令通道分配的缓冲区的速度优先级高于其它通道;和/或The buffer allocated for the instruction channel has a higher speed priority than the other channels; and/or
    为文件数据流通道分配的缓冲区的体积大于其它通道。The buffer allocated for the file stream channel is larger than the other channels.
  5. 根据权利要求1所述的云计算移动终端,其中所述传输管理模块采用的通信协议包括TCP、HTTP、UDP或Web Socket。The cloud computing mobile terminal of claim 1, wherein the communication protocol employed by the transmission management module comprises TCP, HTTP, UDP or Web Socket.
  6. 根据权利要求1所述的云计算移动终端,其中所述云计算服务层包括GUI管理单元,其通过应用程序数据通道,根据激活的所述云系统的GUI接口,在所述人机交互设备的显示器中显示相应的本地GUI界面,并且实时对接指令通道,优先生成本地GUI界面,然后同步本地GUI界面和云端GUI界面。The cloud computing mobile terminal of claim 1, wherein the cloud computing service layer comprises a GUI management unit, through an application data channel, according to an activated GUI interface of the cloud system, at the human-machine interaction device The corresponding local GUI interface is displayed in the display, and the real-time docking instruction channel preferentially generates a local GUI interface, and then synchronizes the local GUI interface and the cloud GUI interface.
  7. 根据权利要求1所述的云计算移动终端,其中所述云计算服务层包括多媒体处理单元,用于对云计算服务器发送的多媒体压缩数据进行解码和通过本地硬件来呈现。The cloud computing mobile terminal of claim 1, wherein the cloud computing service layer comprises a multimedia processing unit for decoding multimedia compressed data sent by the cloud computing server and rendering by local hardware.
  8. 根据权利要求7所述的云计算移动终端,其中所述多媒体处理单元还通过调用本地硬件资源对多媒体压缩数据进行硬解码。The cloud computing mobile terminal of claim 7, wherein the multimedia processing unit further hard decodes the multimedia compressed data by invoking local hardware resources.
  9. 根据权利要求1所述的云计算移动终端,进一步包括资源调配模块,用于调度和分配本地和/或云端的软硬件资源到所述云计算服务层。The cloud computing mobile terminal of claim 1, further comprising a resource provisioning module for scheduling and distributing local and/or cloud hardware and software resources to the cloud computing service layer.
  10. 根据权利要求9所述的云计算移动终端,其中所述资源调配模块根据所述云计算服务层和传输管理模块的请求量和请求优先级,并且根据通信传输单元的网络吞吐,来调整所述软硬件资源的分配量。The cloud computing mobile terminal according to claim 9, wherein said resource provisioning module adjusts said request amount and request priority according to said cloud computing service layer and said transport management module, and according to network throughput of said communication transmission unit The amount of allocation of hardware and software resources.
  11. 根据权利要求9所述的云计算移动终端,其中所述资源调配模块包括:The cloud computing mobile terminal of claim 9, wherein the resource allocation module comprises:
    内存融合单元,用于通过云计算服务器融合其它云计算设备的内存资源;a memory fusion unit, configured to fuse memory resources of other cloud computing devices through a cloud computing server;
    存储融合单元,用于通过云计算服务器融合其它云计算设备的存储资源。A storage convergency unit is configured to consolidate storage resources of other cloud computing devices through a cloud computing server.
  12. 根据权利要求1所述的云计算移动终端,其中:The cloud computing mobile terminal of claim 1 wherein:
    所述基础系统架构包括本地应用服务层,用于提供基础的本地应用程序运行环境;The basic system architecture includes a local application service layer for providing a basic local application running environment;
    所述本地应用服务层与云计算服务器中的云系统的应用服务层同步。The local application service layer is synchronized with an application service layer of the cloud system in the cloud computing server.
  13. 根据权利要求1所述的云计算移动终端,其中所述基础系统架构包括Android架构、Windows架构、Unix架构。The cloud computing mobile terminal of claim 1, wherein the basic system architecture comprises an Android architecture, a Windows architecture, and a Unix architecture.
  14. 根据权利要求1所述的云计算移动终端,其中所述通信传输单元包括移动通信模块,其中所述移动通信模块包括2G、3G、4G和5G网络通信模式中的任意一种或多种。The cloud computing mobile terminal of claim 1, wherein the communication transmission unit comprises a mobile communication module, wherein the mobile communication module comprises any one or more of 2G, 3G, 4G, and 5G network communication modes.
  15. 根据权利要求1所述的云计算移动终端,其中所述通信传输单元还包括Wi-Fi通信模块、蓝牙通信模块和/或近场通信模块。The cloud computing mobile terminal of claim 1, wherein the communication transmission unit further comprises a Wi-Fi communication module, a Bluetooth communication module, and/or a near field communication module.
  16. 根据权利要求1所述的云计算移动终端,其中所述本地硬件还包括用于多媒体处理的专用硬解码器。The cloud computing mobile terminal of claim 1 wherein said local hardware further comprises a dedicated hard decoder for multimedia processing.
  17. 一种云计算移动终端工作方法,其特征在于包括以下步骤:A cloud computing mobile terminal working method, characterized in that the method comprises the following steps:
    A、验证用户请求,接入云计算服务器;A. Verify the user request and access the cloud computing server;
    B、接收基于云计算资源运行的用户定制的云系统的GUI数据和应用程序数据,生成本地GUI界面和关联相应的本地应用程序服务;B. Receive GUI data and application data of a customized cloud system running based on the cloud computing resource, generate a local GUI interface, and associate the corresponding local application service;
    C、捕捉本地硬件接收到的用户动作以及采集云计算移动终端的状态参数,转换为用户指令和应用程序操作数据,然后发送到云计算服务器;C. Capture user actions received by the local hardware and collect state parameters of the cloud computing mobile terminal, convert them into user instructions and application operation data, and then send them to the cloud computing server;
    D、接收更新的云系统的GUI数据和应用程序数据,更新本地GUI界面且同步相应的本地应用程序服务;D. Receive GUI data and application data of the updated cloud system, update the local GUI interface, and synchronize the corresponding local application service;
    E、判断用户是否发出退出指令,是则退出云计算服务,否则返回步骤C。E. Determine whether the user issues an exit instruction, and then exit the cloud computing service, otherwise return to step C.
  18. 根据权利要求17所述的云计算移动终端工作方法,还包括:The method for operating a cloud computing mobile terminal according to claim 17, further comprising:
    实时管理和监控云计算移动终端的通信接口与云计算服务器之间的指令通道、应用程序数据通道和文件数据流通道。Real-time management and monitoring of command channels, application data channels and file data stream channels between the communication interface of the cloud computing mobile terminal and the cloud computing server.
  19. 根据权利要求17所述的云计算移动终端工作方法,还包括:The method for operating a cloud computing mobile terminal according to claim 17, further comprising:
    调度和分配本地和/或云端的软硬件资源,以在本地优化云计算服务运行。Schedule and distribute local and/or cloud hardware and software resources to optimize cloud computing service operations locally.
  20. 一种计算装置,其特征在于,包括储存器和处理器,A computing device, including a storage and a processor,
    其中,所述处理器执行储存于所述存储器中的程序命令,以执行以下步骤:Wherein the processor executes a program command stored in the memory to perform the following steps:
    A、验证用户请求,接入云计算服务器;A. Verify the user request and access the cloud computing server;
    B、接收基于云计算资源运行的用户定制的云系统的GUI数据和应用程序数据,生成本地GUI界面和关联相应的本地应用程序服务;B. Receive GUI data and application data of a customized cloud system running based on the cloud computing resource, generate a local GUI interface, and associate the corresponding local application service;
    C、捕捉本地硬件接收到的用户动作以及采集云计算移动终端的状态参数,转换为用户指令和应用程序操作数据,然后发送到云计算服务器;C. Capture user actions received by the local hardware and collect state parameters of the cloud computing mobile terminal, convert them into user instructions and application operation data, and then send them to the cloud computing server;
    D、接收更新的云系统的GUI数据和应用程序数据,更新本地GUI界面且同步相应的本地应用程序服务;D. Receive GUI data and application data of the updated cloud system, update the local GUI interface, and synchronize the corresponding local application service;
    E、判断用户是否发出退出指令,是则退出云计算服务,否则返回步骤C。E. Determine whether the user issues an exit instruction, and then exit the cloud computing service, otherwise return to step C.
PCT/CN2018/072168 2017-01-11 2018-01-10 Cloud computing mobile terminal and operation method therefor WO2018130165A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE112018000226.8T DE112018000226B4 (en) 2017-01-11 2018-01-10 Mobile cloud computing terminal and operating method therefor

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710021223.X 2017-01-11
CN201710021223.XA CN106713485B (en) 2017-01-11 2017-01-11 Cloud computing mobile terminal

Publications (1)

Publication Number Publication Date
WO2018130165A1 true WO2018130165A1 (en) 2018-07-19

Family

ID=58907346

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/072168 WO2018130165A1 (en) 2017-01-11 2018-01-10 Cloud computing mobile terminal and operation method therefor

Country Status (3)

Country Link
CN (1) CN106713485B (en)
DE (1) DE112018000226B4 (en)
WO (1) WO2018130165A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851255A (en) * 2019-11-07 2020-02-28 之江实验室 A method for cooperating video stream processing based on terminal equipment and edge server
CN111475236A (en) * 2020-02-20 2020-07-31 唐朝 Cloud-operated interaction system and host of cloud-operated system
CN111970342A (en) * 2020-08-03 2020-11-20 江苏方天电力技术有限公司 Edge computing system of heterogeneous network
CN112245903A (en) * 2020-10-26 2021-01-22 腾讯科技(深圳)有限公司 Network state indication method, operating system, device and storage medium in cloud application
CN112272222A (en) * 2020-10-20 2021-01-26 吴荣根 Mobile network resource management simulation cloud computing system based on cloud computing
CN112637353A (en) * 2020-12-28 2021-04-09 北京交通大学 Unified computing resource pool system based on multi-terminal data fusion
CN113422839A (en) * 2021-07-12 2021-09-21 中国电信股份有限公司 Cloud mobile phone system based on cloud computing, control method, medium and electronic device
CN113704167A (en) * 2021-07-19 2021-11-26 上海交通大学 Intelligent sensing terminal system of Internet of things
CN114510263A (en) * 2022-02-16 2022-05-17 腾讯科技(深圳)有限公司 A cloud control method, system, device and storage medium
CN114595051A (en) * 2022-05-10 2022-06-07 中诚华隆计算机技术有限公司 Method and system for enhancing cloud computing cooperation data processing and electronic equipment

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713485B (en) * 2017-01-11 2020-08-04 杨立群 Cloud computing mobile terminal
CN107528887B (en) * 2017-07-26 2020-10-16 广州云晫信息科技有限公司 Distributed cloud system based on fusion unified computing
CN107991909A (en) * 2017-12-05 2018-05-04 长沙瑞晓知识产权服务有限公司 A kind of cloud computing automatic energy-saving control system
US20190340527A1 (en) * 2018-05-07 2019-11-07 Microsoft Technology Licensing, Llc Graphical user interface features for updating a conversational bot
CA3115852A1 (en) 2018-10-22 2020-04-30 Citrix Systems, Inc. Providing virtual desktop within computing environment
CN109739798A (en) * 2018-12-31 2019-05-10 东南大学 Calculator for exam based on cloud computing and its working method
CN109739633B (en) * 2019-01-08 2023-09-15 深圳市网心科技有限公司 A shared computing management method and related devices
CN109743393B (en) * 2019-01-08 2022-03-18 湖南康通电子股份有限公司 Broadcast cloud platform for transmitting instructions, real-time streams and file streams
CN110087009A (en) * 2019-04-17 2019-08-02 深圳沃顿科技有限公司 A kind of LED high definition integration cloud meeting platform control system based on the compatible audio-video processing of Android system platform
US11521114B2 (en) 2019-04-18 2022-12-06 Microsoft Technology Licensing, Llc Visualization of training dialogs for a conversational bot
CN110519234A (en) * 2019-07-31 2019-11-29 茂名市云计算研究院 One kind being based on cloud computing data application terminal device and system
CN110928372A (en) * 2019-12-02 2020-03-27 吴庆余 Cloud computing equipment based on near field communication
CN111132161A (en) * 2019-12-26 2020-05-08 武汉西山艺创文化有限公司 Mobile terminal interaction device and method based on 5G and cloud computing
US11418587B2 (en) 2020-04-30 2022-08-16 T-Mobile Usa, Inc. 5G on-demand dynamically instantiated blockchain for highly distributed peer-to-peer consumer cloud
US11539787B2 (en) 2020-04-30 2022-12-27 T-Mobile Usa, Inc. 5G enabled massively distributed on-demand personal cloud system and method
CN111818120B (en) * 2020-05-20 2023-05-02 北京元心科技有限公司 End cloud user interaction method and system, corresponding equipment and storage medium
CN113821281B (en) * 2020-06-18 2025-09-05 阿里巴巴集团控股有限公司 Display data processing method, device, electronic device and computer storage medium
CN111866138A (en) * 2020-07-17 2020-10-30 李飞 Cloud mobile phone configured with cloud system operation
CN112000605B (en) * 2020-08-26 2022-07-08 北京控制与电子技术研究所 Method and device for transmitting instructions and data
CN112866404B (en) * 2021-02-03 2023-01-24 视若飞信息科技(上海)有限公司 Semi-cloud system and execution method
CN113411503B (en) * 2021-07-01 2022-09-13 上海卓易科技股份有限公司 Cloud mobile phone camera preview method and device, computer equipment and storage medium
CN114138145B (en) * 2021-11-30 2024-05-28 武汉噢易云计算股份有限公司 File dragging method, device and equipment for application virtualization and readable storage medium
CN114510270A (en) * 2021-12-31 2022-05-17 杭州电子科技大学 Programmable controller cloud development system architecture based on B/S architecture
CN115944910A (en) * 2022-12-28 2023-04-11 元境生生(北京)科技有限公司 Cloud game interaction method and system, electronic equipment and storage medium
CN116107435A (en) * 2023-04-11 2023-05-12 深圳飞蝶虚拟现实科技有限公司 3D remote interaction action synchronization system based on 5G cloud computing
CN120035981A (en) * 2023-07-05 2025-05-23 杨立群 Cross-platform cloud operating system and method thereof
CN118466854B (en) * 2024-07-09 2024-10-11 深圳市领德创科技有限公司 Mobile phone hard disk for adapting multiple platforms

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080080396A1 (en) * 2006-09-28 2008-04-03 Microsoft Corporation Marketplace for cloud services resources
CN102209111A (en) * 2011-05-20 2011-10-05 重庆广典传媒有限公司 Open cross-platform system for cloud computing mobile network terminal equipment
CN102377739A (en) * 2010-08-11 2012-03-14 中兴通讯股份有限公司 Mobile terminal as well as realization method, service system and cloud server thereof
CN105657060A (en) * 2016-03-17 2016-06-08 深圳市楚邦智能技术有限公司 Intelligent equipment cloud platform management system
CN106713485A (en) * 2017-01-11 2017-05-24 杨立群 Cloud computing mobile terminal and working method thereof

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2878254B1 (en) * 2004-11-22 2010-08-20 Bio Rad Pasteur COMPOSITION FOR AMPLIFICATION OF NUCLEIC ACIDS
CN103345406A (en) 2013-06-21 2013-10-09 中国科学院深圳先进技术研究院 System and method for achieving cloud virtual mobile terminal of intelligent mobile terminal
US10346810B2 (en) 2015-03-24 2019-07-09 MINDBODY, Inc. Event scheduling

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080080396A1 (en) * 2006-09-28 2008-04-03 Microsoft Corporation Marketplace for cloud services resources
CN102377739A (en) * 2010-08-11 2012-03-14 中兴通讯股份有限公司 Mobile terminal as well as realization method, service system and cloud server thereof
CN102209111A (en) * 2011-05-20 2011-10-05 重庆广典传媒有限公司 Open cross-platform system for cloud computing mobile network terminal equipment
CN105657060A (en) * 2016-03-17 2016-06-08 深圳市楚邦智能技术有限公司 Intelligent equipment cloud platform management system
CN106713485A (en) * 2017-01-11 2017-05-24 杨立群 Cloud computing mobile terminal and working method thereof

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851255A (en) * 2019-11-07 2020-02-28 之江实验室 A method for cooperating video stream processing based on terminal equipment and edge server
CN111475236A (en) * 2020-02-20 2020-07-31 唐朝 Cloud-operated interaction system and host of cloud-operated system
CN111970342A (en) * 2020-08-03 2020-11-20 江苏方天电力技术有限公司 Edge computing system of heterogeneous network
CN111970342B (en) * 2020-08-03 2024-01-30 江苏方天电力技术有限公司 Edge computing system of heterogeneous network
CN112272222A (en) * 2020-10-20 2021-01-26 吴荣根 Mobile network resource management simulation cloud computing system based on cloud computing
CN112245903B (en) * 2020-10-26 2022-05-03 腾讯科技(深圳)有限公司 Network state indication method, operating system, device and storage medium in cloud application
CN112245903A (en) * 2020-10-26 2021-01-22 腾讯科技(深圳)有限公司 Network state indication method, operating system, device and storage medium in cloud application
CN112637353A (en) * 2020-12-28 2021-04-09 北京交通大学 Unified computing resource pool system based on multi-terminal data fusion
CN113422839A (en) * 2021-07-12 2021-09-21 中国电信股份有限公司 Cloud mobile phone system based on cloud computing, control method, medium and electronic device
CN113704167A (en) * 2021-07-19 2021-11-26 上海交通大学 Intelligent sensing terminal system of Internet of things
CN113704167B (en) * 2021-07-19 2024-03-19 上海交通大学 Internet of Things Intelligent Sensing Terminal System
CN114510263A (en) * 2022-02-16 2022-05-17 腾讯科技(深圳)有限公司 A cloud control method, system, device and storage medium
CN114595051A (en) * 2022-05-10 2022-06-07 中诚华隆计算机技术有限公司 Method and system for enhancing cloud computing cooperation data processing and electronic equipment
CN114595051B (en) * 2022-05-10 2022-07-08 中诚华隆计算机技术有限公司 Method and system for enhancing cloud computing cooperative data processing and electronic equipment

Also Published As

Publication number Publication date
DE112018000226B4 (en) 2024-11-14
CN106713485B (en) 2020-08-04
CN106713485A (en) 2017-05-24
DE112018000226T5 (en) 2019-09-05

Similar Documents

Publication Publication Date Title
WO2018130165A1 (en) Cloud computing mobile terminal and operation method therefor
US10298721B2 (en) Method and system to determine a work distribution model for an application deployed on a cloud
CN106850589B (en) Method for managing and controlling operation of cloud computing terminal and cloud server
WO2020221190A1 (en) Applet state synchronization method, device and computer storage medium
WO2017124860A1 (en) Distributed wireless multi-screen virtual machine service system
WO2016197862A1 (en) Data transmission method and apparatus, and intelligent television system
JP2021513440A (en) Methods and devices for transmitting scene images of virtual scenes, computer devices and computer readable storage media
US20110145431A1 (en) Systems and methods for remotely presenting a multimedia stream
US9762699B2 (en) Hierarchical display-server system and method
US9723337B2 (en) Distribution control system and distribution system
US9628866B2 (en) Distribution control system and distribution system
US9781193B2 (en) Distribution control system, distribution system, distribution control method, and computer-readable storage medium
EP2790383B1 (en) Distribution control system, distribution system, distribution control method, and computer-readable storage medium
US20140282039A1 (en) Distribution control system, distribution system, distribution control method, and computer-readable storage medium
CN114598931A (en) Streaming method, system, device and medium for multi-open cloud game
CN102855133A (en) Interactive system of computer processing unit
WO2016202102A1 (en) Message transmission method and device
EP2974317B1 (en) Computer system, distribution control system, distribution control method, and computer-readable storage medium
CN113849271B (en) Cloud desktop display method, device, device, system and storage medium
TW201701152A (en) Network server system
CN102857531A (en) Remote interactive system based on cloud computing
Tang et al. Application research of desktop virtualization technology based on VOI in computer room management of colleges and universities
CN115617540A (en) Implementation method, device, system and storage medium of a cloud clipboard
KR102537913B1 (en) Method And Apparatus for Displaying VMI Screen and Local Screen in Specific Region
Baratto THINC: a virtual and remote display architecture for desktop computing and mobile devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18739073

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 18739073

Country of ref document: EP

Kind code of ref document: A1