CN110019145A - A kind of multi-environment cascade method and apparatus of big data platform - Google Patents
A kind of multi-environment cascade method and apparatus of big data platform Download PDFInfo
- Publication number
- CN110019145A CN110019145A CN201810631197.7A CN201810631197A CN110019145A CN 110019145 A CN110019145 A CN 110019145A CN 201810631197 A CN201810631197 A CN 201810631197A CN 110019145 A CN110019145 A CN 110019145A
- Authority
- CN
- China
- Prior art keywords
- environment
- data processing
- processing object
- cascade
- junior
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2246—Trees, e.g. B+trees
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Stored Programmes (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a kind of multi-environment cascade method and apparatus of big data platform.The multi-environment cascade method of big data platform includes: creation multi-stage environmental；Configuration surroundings cascade connection；Newdata is dealt with objects in junior's environment, and verifies the data processing object；Pass through if the data processing object is verified, submitted in junior's environment and issues the data processing object；And the data processing object that audit is issued, and if the audit passes through, according to the environment cascade connection, identical data processing object is mapped in higher level's environment cascade of junior's environment.
Description
Technical field
The present invention relates to computer technology, the particularly multi-environment cascade method and system of big data platform.
Background technique
Big data technology there has been at present to be widely applied.A variety of big data handling implements are had existed, such as distributed
Computational frame Hadoop, Tool for Data Warehouse Hive, the distributed system Spark calculated based on memory, large-scale graph data meter
Calculate platform Giraph etc..By means of varied computing platform, data mining personnel can create various types of objects daily
Data are processed, analyze, and it is expected that object once creates can repeatedly be multiplexed under various circumstances.Therefore, there is an urgent need to one
The cascade method of multi-stage environmental is planted uniformly to issue and be multiplexed object.
The prior art has been given some solutions regarding to the issue above, such as based on exploitation environment and production environment
Associated method, and the method based on the export and importing that are packaged object.
However, there are still defects for the solution of the prior art.Due to being simple consideration exploitation and production environment
Association, therefore it is not able to satisfy business demand of the data mining personnel under test scene, and object can not be copied to all
In other identical production environments.In addition, the method for export and importing that object is packaged is created in a platform or environment
Batch of data working process task or object are built.If it is desired to these tasks or object are transplanted in other environment or platform,
Then they can only be integrally downloaded and export as file, then upload file to import and use.It will be unable to disposably lead in this way
Enter into multiple environment, if the error of a certain environment may need to be deleted and restored one by one in all environment, and
It can not carry out effective version management.
Summary of the invention
According to an aspect of the present invention, a kind of multi-environment cascade method of big data platform includes: to create multistage ring
Border；Configuration surroundings cascade connection；Newdata is dealt with objects in junior's environment, and verifies the data processing object；If
The data processing object, which is verified, to be passed through, then submits in junior's environment and issue the data processing object；And it examines
The data processing object that core is issued, and if the audit passes through, according to the environment cascade connection, in the junior
Higher level's environment cascade of environment maps identical data processing object.
The environment cascade connection includes exploitation environment and production environment, junior's environment are the exploitation environment, institute
State the higher level that production environment is the exploitation environment.
The environment cascade connection from most junior to most higher level successively include exploitation environment, test environment, gray scale environment and
Production environment, and from most junior into uppermost cascade mapping process, at data of every level-one all to the publication
Reason object is verified.
The environment cascade connection successively includes outsourcing development environment from most junior to most higher level, internal exploitation environment, surveys
Test ring border, gray scale environment and production environment, from most junior into uppermost cascade mapping process, in every level-one all to described
The data processing object of publication is verified, and the method also includes: implement access authorization for resource control, with can be to the big number
Isolation Management is carried out according to the data in platform.
The environment cascade connection further includes the cluster configuration information of every grade of environment in the multi-stage environmental.The configuration ring
The step of border cascade connection, is carried out in visualization interface.The environment cascade connection is stored in tree-like data structure
In.The data processing object includes: task, script, resource, function.It is described that submit operation include the data after verified
Process object is put into list to be released.The publication operation includes one group of relevant data processing object uniform packing of selection
With creation publication packet.Environment not at the same level corresponds to different storage computing clusters in the multi-stage environmental.Described different
Implement Network Isolation between storage computing cluster.The cascade map operation is implemented under cloud environment.The cascade mapping
Operation is that the data processing object is mapped to private clound, proprietary cloud or local computer room from public cloud cascade.
According to an aspect of the present invention, a kind of multi-environment cascade device of big data platform includes: more for creating
The module of grade environment；Module for configuration surroundings cascade connection；For in junior's environment newdata deal with objects, and test
Demonstrate,prove the module of the data processing object；Pass through if be verified for the data processing object, in junior's environment
Middle submission and the module for issuing the data processing object；And for auditing issued data processing object, and if institute
It states audit to pass through, then according to the environment cascade connection, maps identical number in higher level's environment cascade of junior's environment
According to the module of process object.
The environment cascade connection includes exploitation environment and production environment, junior's environment are the exploitation environment, institute
State the higher level that production environment is the exploitation environment.
The environment cascade connection from most junior to most higher level successively include exploitation environment, test environment, gray scale environment and
Production environment, and from most junior into uppermost cascade mapping process, at data of every level-one all to the publication
Reason object is verified.
The environment cascade connection successively includes outsourcing development environment from most junior to most higher level, internal exploitation environment, surveys
Test ring border, gray scale environment and production environment, from most junior into uppermost cascade mapping process, in every level-one all to described
The data processing object of publication is verified, and described device further include: for implementing access authorization for resource control, with can be to described
Data in big data platform carry out the module of Isolation Management.
The environment cascade connection further includes the cluster configuration information of every grade of environment in the multi-stage environmental.It is described to be used to match
The module for setting environment cascade connection is run in visualization interface.The environment cascade connection is stored in tree-like data knot
In structure.The data processing object includes: task, script, resource, function.If described be used for the data processing object quilt
It is verified, is then submitted in junior's environment and the module for issuing the data processing object is also used to the number after verified
It is put into list to be released according to process object.If described be verified for the data processing object passes through, described
It is submitted in junior's environment and the module for issuing the data processing object is also used to select one group of relevant data processing object unified
It is packaged to create publication packet.Environment not at the same level corresponds to different storage computing clusters in the multi-stage environmental.It is described not
It can implement Network Isolation between same storage computing cluster.It is described to be used to audit issued data processing object, and such as
Audit described in fruit passes through, then identical in higher level's environment cascade mapping of junior's environment according to the environment cascade connection
The cascade mapping function of module of data processing object can implement under cloud environment.The cascade mapping function be by
The data processing object is mapped to private clound, proprietary cloud or local computer room from public cloud cascade.
An aspect of of the present present invention discloses a kind of computer-readable medium, is stored thereon with computer-readable instruction, described
The multi-environment cascade method of big data platform as described above is able to carry out when computer-readable instruction is computer-executed.
Since present invention employs multi-stage environmentals, can be handled under multilayer environment simultaneously, the environment is similar
In: exploitation environment, test environment, gray scale environment, production environment A, production environment B etc..It can split hair environmental objects progress institute
There is the publication of higher level's environment.
The invention proposes a kind of multi-stage environmental Cascading Methods.This method passes through the mapping object between environment simultaneously, can
It is multiplexed and is verified with release quickly, and can cascaded and use each different cloud environment.When creating certain under a certain junior's environment
When an object, it can be mapped by cascade, by the object release quickly into its all higher level's environment, and be guaranteed between environment
Isolation.The embodiment of the present invention also supports the dynamic of multi-stage environmental to add and delete.
Therefore, embodiment through the invention is solved in the multi-stage environmental cascade connection of big data platform, varying environment
The rapid multiplexing problem of lower object (task, script, resource, function etc.).
Detailed description of the invention
Fig. 1 shows multi-stage environmental architecture diagram according to an embodiment of the present invention.
Fig. 2 shows multi-stage environmental business structure figures according to an embodiment of the present invention.
Fig. 3 shows customized multi-stage environmental flow chart according to an embodiment of the present invention.
Fig. 4 shows heterogeneous network environment cascade graphs according to an embodiment of the present invention.
Specific embodiment
The contents of the present invention are discussed now with reference to several exemplary embodiments.It should be appreciated that discussing these implementations
Example is rather than dark merely to better understood when those of ordinary skill in the art and therefore realize the contents of the present invention
Show any restrictions to the scope of the present invention.
As used herein, term " includes " and its variant will be read as meaning opening " including but not limited to "
Put formula term.Term "based" will be read as " being based at least partially on ".Term " one embodiment " and " a kind of embodiment "
It is read as " at least one embodiment ".Term " another embodiment " will be read as " at least one other embodiment ".
The embodiment of the present invention is a kind of customized multi-stage environmental framework, by the resource isolation in different environment, energy
Enough ensure data safety.As shown in Figure 1, the framework includes four layers: client layer, gateway layer, Business Logic, storage computation layer.
● client layer: client layer is visualization interface layer, and user (such as developer) can pass through letter on interface
It is easy to operate to configure multi-stage environmental and create object (resource, function, script, task).
● gateway layer: when front end (for example, browser) there is user to send request (content of request is usually some parameters letter
Breath, for example, user name, password etc.) when coming, carrying out delivery of services by gateway layer, (delivery of services, which refers to, sends out each browser
The request sent, which is assigned in different back-end servers, to be executed).For example, can be using the RPC (Remote of open source
Procedure Call) frame DUBBO carries out delivery of services, and plurality of back-end server is registered to net by zookeeper
Close platform.
Business Logic: Business Logic is responsible for the possible very complicated service logic of processing, and (service logic refers to that processing is each
The process of kind operation), task is instantiated, and the example of task is submitted in bottom memory and is run.Service logic
The function of layer includes the function related with business demand such as the formulation of business rule, realization of operation flow.Wherein, each run
Task can all generate a new example.Example normal operation can undergo wait run, run and to the end of three phases.For example, for
Task A, the example ID for running generation twice is respectively: T_630_20180301115903046_1, T_630_
20180301120009801_1。
● storage computation layer: storage computation layer is used to realize data storage, data computing function.Typically, storage meter
Layer is calculated using hadoop cluster as main storage computing cluster, but the embodiment of the present invention platform is supported various types of numbers
According to source as storage computing cluster (such as: MySQL, Greenplum etc.).
The division of the common environment of each embodiment according to the present invention is illustratively explained below with reference to Fig. 2, and
And entire multi-environment the operational flowchart used will be cascaded to be illustratively described referring to Fig. 3.
In multi-stage environmental, bottom cluster can be mutually isolated, to guarantee data security；Bottom cluster can configure full side
The data permission of position, with the data permission different for different personnel assignments.Implementation of the invention guarantees that task can be in difference
It is multiplexed between environment, the primary creation data processing object of realization (it includes: task, script, resource, function etc.) and can be multiple
The data processing object is run, data mining person works can be greatlied simplify in this way (for example, when saving 80% work
Between).In an embodiment of the present invention, the cluster of each environment can be in different cloud, such as: exploitation cluster is in Ali's cloud
Upper, test environment is stored in Huawei's cloud, production cluster in local computer room.By data mining personnel in the developing creating environments of the task
After running successfully, test can be published to, in production environment, can be realized the object reuse of across a network environment in this way.
The multi-stage environmental business structure of the embodiment of the present invention is as shown in Fig. 2, it can be realized environment money in big data platform
The control and isolation in source, permission, can be such that several developers develop jointly online, to improve development efficiency.
According to an embodiment of the invention, different enterprises can flexible and customized oneself environmental pattern of configuration.Often
Mode has single-mode (production), normal mode (exploitation, production), rigorous model (exploitation, test, gray scale, production), outside
Pack mode (outsourcing development, internal exploitation, test, gray scale, production) etc.:
● single-mode: only having production environment, and data mining personnel directly generate data processing object in the present context.
● data processing pair normal mode: is generated in the case where developing environment comprising exploitation and production environment, data mining personnel
As, and it is published to production environment.
● rigorous model: comprising four kinds of exploitation, test, gray scale, production environment, developed in strict accordance with project development process
And data processing object is created, and data processing object publishing is verified data processing object to higher level's environment one by one.
● Outsourcing Model: comprising five kinds of outsourcing development, internal exploitation, test, gray scale, production environment, with addition of moneys
Permission control in source can carry out Isolation Management to data.
The multi-environment Cascading Methods of embodiment according to the present invention are as shown in figure 3, include the following steps:
(1) multi-stage environmental, the cluster configuration of customized every grade of environment are created.Wherein, cluster configuration information can be according to reality
Depending on the situation of border, the mainly configuration of cluster and database information, such as:
Exploitation environment cluster configuration include: the address hdfs=127.0.0.1:8020, yarn scheduling address=
127.0.0.1:8088, scheduling queue=dev and database=demo_dev.Testing environment cluster configuration includes: the address hdfs
=test:8020, yarn dispatches address=test:8088, scheduling queue=test and database=demo_test.
(2) customized configuration surroundings cascade connection.
Wherein, the embodiment of the present invention is the configuration surroundings cascade connection in visualization interface, such as: develop the upper of environment
Grade is test environment, and the higher level for testing environment is gray scale environment.The data structure of reaction environment cascade connection can be tree-like knot
Structure, higher level's environment of certain grade of environment can have or multiple, but can not be cascaded across grade.
(3) data mining personnel newdata process object (task, script, resource, function etc.) in most junior's environment,
And test is run with the correctness of identifying object.
Wherein, the content of verifying is the object of data processing.For example, it is assumed that will be from being similar to " the horse of toilet in my family
Bucket leak ", " my family's door is broken " etc. parse the amount that certain type of cell is complained in the mass data in relation to estate management, just
Need to create some functions or SQL statement (data processing object)；Then to running these functions or SQL language in initial data
Sentence, and verify according to operation result the correctness of these functions or SQL statement.
(4) the data mart modeling object after verifying is submitted, data mining personnel create publication packet.
Wherein, it is to be released to refer to that data developer is put into the data processing object of the data after verifying after tested for submission
In list, one group of data processing object uniform packing relevant to business is selected later to create publication packet.Operation maintenance personnel passes through
Audit publication packet is to be published to this group task in higher level's environment.
(5) after release management person is by publication audit, higher level cascades environment and possesses identical data process object, can make
Identical data processing object is directly run under the cluster environment.Wherein, operation maintenance personnel is by audit publication packet come this group
Task is published in higher level's environment.The whole flow process of publication includes: that packet, audit publication packet, times after the approval are issued in creation
Business duplication.After the approval, higher level environment of the identical task of piece of content to cascade mapping will be replicated from exploitation environment
In, wherein the contents such as the title of task, level, dependence, configuration relation are all identical.In the disclosure, cascade mapping
Refer to: to certain object under Mr. Yu's environment, higher level's environment of the environment being made to possess the operation of same object.
According to one embodiment of present invention, cascade mapping relations can be configured in visualization interface, such as: Ke Yixuan
Junior's environment of exploitation environment is selected for test environment, by exploitation environment and test environment cascade mapping；Cascade the data knot of mapping
Structure is tree structure, and junior's environment of certain grade of environment can have one or more, but can not carry out cascade mapping across grade.
One embodiment of the present of invention supports the storage computing cluster under heterogeneous network environment, under various circumstances can be right
Answer different storage computing clusters.The embodiment of heterogeneous network environment framework is as shown in Figure 4.As seen from Figure 4, depositing for environment is developed
Storage computing cluster is deployed in Ali's cloud environment, is developing the task run of the data mart modeling of creating environments in Ali's cloud cluster machine
In device.After the test of task is verified, by task publication (also being understood as Task Duplication) into test environment.Wherein,
The cluster of environment is tested in Huawei's cloud, task definition can operate normally in the cluster environment of Huawei's cloud.Finally by task
It is published in gray scale environment, and is published in production environment again by gray scale environment, the cluster that gray scale environment and production environment use
It is deployed in local computer room.Cluster A, cluster B, the Technology Selection of cluster C are necessary identical.Such as.If developing the cluster A of environment
Hadoop, spark script environment are used, then the cluster C for testing the cluster B of environment, gray scale and production environment requires to make
With hadoop, spark script environment.
In addition, carrying out Network Isolation between cluster, do not communicated mutually between each cluster.The physical store of task and duplication are
It is realized using business library.
The embodiment of the present invention can support the resource isolation between customized multi-stage environmental cascade and environment.In addition,
The embodiment of the present invention can support the publication of the object (task, resource, function etc.) between multi-stage environmental.In addition, of the invention
Embodiment can also further support the cascade under various cloud environments to issue, and can from public cloud cascade be published to it is privately owned
Cloud, proprietary cloud or local computer room.
In the disclosure, statement " user " refers to " user ".
The method and apparatus of various embodiments of the present invention can be implemented as pure software and (such as be write with Java language
Software program), it also can according to need and be embodied as pure hardware (such as dedicated ASIC chip or fpga chip), it can be with
It is embodied as combining the system (such as the fixer system for being stored with fixed code) of software and hardware.
Another aspect of the present invention is a kind of computer-readable medium, is stored thereon with computer-readable instruction, described
Instruct the method for being performed implementable various embodiments of the present invention.
Various embodiments of the present invention are described above, above description is exemplary, and non-exclusive, and
It is not limited to the disclosed embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes are obvious for the those of ordinary skill in art field.The range of claimed theme only by
The attached claims are defined.
Claims (29)
1. a kind of multi-environment cascade method of big data platform, comprising:
Create multi-stage environmental；
Configuration surroundings cascade connection；
Newdata is dealt with objects in junior's environment, and verifies the data processing object；
Pass through if the data processing object is verified, submitted in junior's environment and issues the data processing pair
As；And
Issued data processing object is audited, and if the audit passes through, according to the environment cascade connection, in institute
The higher level's environment cascade for stating junior's environment maps identical data processing object.
2. according to the method described in claim 1, wherein, the environment cascade connection includes exploitation environment and production environment, institute
Stating junior's environment is the exploitation environment, and the production environment is the higher level of the exploitation environment.
3. according to the method described in claim 1, wherein, the environment cascade connection successively includes out from most junior to most higher level
Hair ring border, test environment, gray scale environment and production environment, and
, into uppermost cascade mapping process, all the data processing object of the publication is carried out in every level-one from most junior
Verifying.
4. according to the method described in claim 1, wherein, the environment cascade connection successively includes outer from most junior to most higher level
Packet exploitation environment, internal exploitation environment, test environment, gray scale environment and production environment,
, into uppermost cascade mapping process, all the data processing object of the publication is carried out in every level-one from most junior
Verifying, and the method also includes:
Implement access authorization for resource control, Isolation Management can be carried out to the data in the big data platform.
5. according to the method described in claim 1, wherein the environment cascade connection further includes every grade of ring in the multi-stage environmental
The cluster configuration information in border.
6. according to the method described in claim 1, wherein the configuration surroundings cascade connection the step of be in visualization interface
It carries out.
7. according to the method described in claim 1, wherein the environment cascade connection is stored in tree-like data structure.
8. according to the method described in claim 1, wherein the data processing object includes: task, script, resource, function.
9. according to the method described in claim 1, wherein described, to submit operation include that the data processing object after verified is put
Enter into list to be released.
10. according to the method described in claim 9, wherein the publication operation includes one group of relevant data processing object of selection
Uniform packing is to create publication packet.
11. according to the method described in claim 1, wherein environment not at the same level in the multi-stage environmental corresponds to different storages
Computing cluster.
12. according to the method for claim 11, wherein implementing to implement between the different storage computing cluster
Network Isolation.
13. according to the method described in claim 1, wherein the cascade map operation is implemented under cloud environment.
14. according to the method for claim 13, wherein the cascade map operation is by the data processing object from public affairs
There is cloud cascade to be mapped to private clound, proprietary cloud or local computer room.
15. a kind of multi-environment cascade device of big data platform, comprising:
For creating the module of multi-stage environmental；
Module for configuration surroundings cascade connection；
For in junior's environment newdata deal with objects, and verify the module of the data processing object；
Pass through if be verified for the data processing object, submitted in junior's environment and issues the data processing
The module of object；And
For auditing issued data processing object, and if the audit passes through, according to the environment cascade connection,
The module of identical data processing object is mapped in higher level's environment cascade of junior's environment.
16. device according to claim 15, wherein the environment cascade connection includes to develop environment and production environment,
Junior's environment is the exploitation environment, and the production environment is the higher level of the exploitation environment.
17. device according to claim 15, wherein the environment cascade connection successively includes from most junior to most higher level
Environment, test environment, gray scale environment and production environment are developed, and
, into uppermost cascade mapping process, all the data processing object of the publication is carried out in every level-one from most junior
Verifying.
18. device according to claim 15, wherein the environment cascade connection successively includes from most junior to most higher level
Outsourcing development environment, internal exploitation environment, test environment, gray scale environment and production environment,
, into uppermost cascade mapping process, all the data processing object of the publication is carried out in every level-one from most junior
Verifying, and described device further include:
For implementing access authorization for resource control, can the data in the big data platform be carried out with the module of Isolation Management.
19. device according to claim 15, wherein the environment cascade connection further includes every grade in the multi-stage environmental
The cluster configuration information of environment.
20. device according to claim 15, wherein the module for configuration surroundings cascade connection is to visualize
It is run in interface.
21. device according to claim 15, wherein the environment cascade connection is stored in tree-like data structure.
22. device according to claim 15, wherein the data processing object includes: task, script, resource, function.
23. device according to claim 15 passes through if be verified described in wherein for the data processing object,
It is submitted in junior's environment and the module for issuing the data processing object is also used to the data processing object after verified
It is put into list to be released.
24. device according to claim 23 passes through if be verified described in wherein for the data processing object,
It is submitted in junior's environment and the module for issuing the data processing object is also used to select one group of relevant data processing pair
As uniform packing to create publication packet.
25. device according to claim 15, wherein environment not at the same level in the multi-stage environmental corresponds to different deposit
Store up computing cluster.
26. device according to claim 25, wherein network can be implemented between the different storage computing cluster
Isolation.
27. device according to claim 15, wherein it is described for auditing issued data processing object, and if
The audit passes through, then identical in higher level's environment cascade mapping of junior's environment according to the environment cascade connection
The cascade mapping function of the module of data processing object can be implemented under cloud environment.
28. device according to claim 27, wherein the cascade mapping function is by the data processing object from public affairs
There is cloud cascade to be mapped to private clound, proprietary cloud or local computer room.
29. a kind of computer-readable medium is stored thereon with computer-readable instruction, the computer-readable instruction is by computer
The method as described in one of any in claim 1-14 is able to carry out when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810631197.7A CN110019145B (en) | 2018-06-19 | 2018-06-19 | Multi-environment cascading method and device for big data platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810631197.7A CN110019145B (en) | 2018-06-19 | 2018-06-19 | Multi-environment cascading method and device for big data platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110019145A true CN110019145A (en) | 2019-07-16 |
| CN110019145B CN110019145B (en) | 2021-09-14 |
Family
ID=67188360
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810631197.7A Active CN110019145B (en) | 2018-06-19 | 2018-06-19 | Multi-environment cascading method and device for big data platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110019145B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113010421A (en) * | 2021-03-16 | 2021-06-22 | 北京奇艺世纪科技有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN113741970A (en) * | 2021-08-09 | 2021-12-03 | 广州市易工品科技有限公司 | Method and device for realizing separation of production environment and development environment of data warehouse |
| CN115576793A (en) * | 2021-06-21 | 2023-01-06 | 青岛海尔科技有限公司 | Data processing method, system and device |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150082280A1 (en) * | 2013-09-18 | 2015-03-19 | Yahoo! Inc. | Automatic verification by comparing user interface images |
| CN104516738A (en) * | 2014-12-15 | 2015-04-15 | 北京金和软件股份有限公司 | Integrated implementing method for development and release of APP |
| US9405661B1 (en) * | 2015-04-23 | 2016-08-02 | International Business Machines Corporation | Resource-constrained test automation |
| CN106095501A (en) * | 2016-06-12 | 2016-11-09 | 华为软件技术有限公司 | A kind of application section arranging method and device |
| CN106649457A (en) * | 2016-09-26 | 2017-05-10 | 天津海量信息技术股份有限公司 | Data processing frame based on object relation mapping technology |
| CN106959872A (en) * | 2017-03-16 | 2017-07-18 | 微梦创科网络科技（中国）有限公司 | Using loading method and device |
| CN107797806A (en) * | 2016-08-29 | 2018-03-13 | 北京雪球信息科技有限公司 | A kind of dispositions method of program |
| CN107797914A (en) * | 2016-09-07 | 2018-03-13 | 阿里巴巴集团控股有限公司 | Code process method, apparatus and code delivery system |
| CN107870772A (en) * | 2017-10-09 | 2018-04-03 | 深圳前海微众银行股份有限公司 | Cross-environment application deployment method, platform, system and readable storage medium |
| CN107943486A (en) * | 2017-12-19 | 2018-04-20 | 北京星河星云信息技术有限公司 | A kind of multilingual code compiling method, distribution method, device and system |
| CN108073504A (en) * | 2016-11-17 | 2018-05-25 | 北京京东尚科信息技术有限公司 | For debugging the method, apparatus of distributed system and debugging system |
-
2018
- 2018-06-19 CN CN201810631197.7A patent/CN110019145B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150082280A1 (en) * | 2013-09-18 | 2015-03-19 | Yahoo! Inc. | Automatic verification by comparing user interface images |
| CN104516738A (en) * | 2014-12-15 | 2015-04-15 | 北京金和软件股份有限公司 | Integrated implementing method for development and release of APP |
| US9405661B1 (en) * | 2015-04-23 | 2016-08-02 | International Business Machines Corporation | Resource-constrained test automation |
| CN106095501A (en) * | 2016-06-12 | 2016-11-09 | 华为软件技术有限公司 | A kind of application section arranging method and device |
| CN107797806A (en) * | 2016-08-29 | 2018-03-13 | 北京雪球信息科技有限公司 | A kind of dispositions method of program |
| CN107797914A (en) * | 2016-09-07 | 2018-03-13 | 阿里巴巴集团控股有限公司 | Code process method, apparatus and code delivery system |
| CN106649457A (en) * | 2016-09-26 | 2017-05-10 | 天津海量信息技术股份有限公司 | Data processing frame based on object relation mapping technology |
| CN108073504A (en) * | 2016-11-17 | 2018-05-25 | 北京京东尚科信息技术有限公司 | For debugging the method, apparatus of distributed system and debugging system |
| CN106959872A (en) * | 2017-03-16 | 2017-07-18 | 微梦创科网络科技（中国）有限公司 | Using loading method and device |
| CN107870772A (en) * | 2017-10-09 | 2018-04-03 | 深圳前海微众银行股份有限公司 | Cross-environment application deployment method, platform, system and readable storage medium |
| CN107943486A (en) * | 2017-12-19 | 2018-04-20 | 北京星河星云信息技术有限公司 | A kind of multilingual code compiling method, distribution method, device and system |
Non-Patent Citations (1)
| Title |
|---|
| 王晓峻，等: "4A系统代码重构的软件开发实践", 《电信技术》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113010421A (en) * | 2021-03-16 | 2021-06-22 | 北京奇艺世纪科技有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN113010421B (en) * | 2021-03-16 | 2023-09-01 | 北京奇艺世纪科技有限公司 | Data processing method, device, electronic equipment and storage medium |
| CN115576793A (en) * | 2021-06-21 | 2023-01-06 | 青岛海尔科技有限公司 | Data processing method, system and device |
| CN113741970A (en) * | 2021-08-09 | 2021-12-03 | 广州市易工品科技有限公司 | Method and device for realizing separation of production environment and development environment of data warehouse |
| CN113741970B (en) * | 2021-08-09 | 2024-02-02 | 广州市易工品科技有限公司 | Method and device for realizing separation of data warehouse production environment and development environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110019145B (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105830049B (en) | Automatic change experiment platform | |
| CN101946258B (en) | Model-Based Deployment of Computer-Based Business Processes on Dedicated Hardware | |
| CN104954453B (en) | Cloud computing-based data mining REST service platform | |
| Yussupov et al. | A systematic mapping study on engineering function-as-a-service platforms and tools | |
| US20170038919A1 (en) | Event-driven data processing system | |
| US20170255886A1 (en) | Workflow execution | |
| CN109240900A (en) | Block chain network service platform and its intelligent contract detection method, storage medium | |
| CN107888681A (en) | A kind of business flow processing method and device | |
| Vu et al. | Legacy application migration to the cloud: Practicability and methodology | |
| CN110088749A (en) | Automated ontology generates | |
| CN108762900A (en) | High frequency method for scheduling task, system, computer equipment and storage medium | |
| CN101946260A (en) | Modelling computer based business process for customisation and delivery | |
| CN101946261A (en) | Automated model generation for computer based business process | |
| CN101946257A (en) | Modelling computer based business process and simulating operation | |
| US8752030B1 (en) | Process abstraction and tracking, systems and methods | |
| CN110019145A (en) | A kind of multi-environment cascade method and apparatus of big data platform | |
| US20210248278A1 (en) | Process architecture modeling platform | |
| Tankov et al. | Kotless: A serverless framework for kotlin | |
| Schwarz et al. | ABMland-a tool for agent-based model development on urban land use change | |
| US7636911B2 (en) | System and methods for capturing structure of data models using entity patterns | |
| Karim et al. | A proposed novel enterprise cloud development application model | |
| Zhou et al. | Modeling, design, and implementation of a cloud workflow engine based on aneka | |
| Garverick et al. | Implementing Event-Driven Microservices Architecture in. NET 7: Develop event-based distributed apps that can scale with ever-changing business demands using C# 11 and. NET 7 | |
| CN115145762B (en) | Intelligent data protection and verification system management method, platform and computer equipment | |
| Alodib et al. | A Big Data approach to enhance the integration of Access Control Policies for Web Services |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230224 Address after: 430050 302, Floor 3, No. 114, Hanyang Avenue, Hanyang District, Wuhan, Hubei Province Patentee after: Wuhan Shulan Technology Co.,Ltd. Address before: Room 309, building 2, 1 cangxing Road, Cangqian street, Yuhang District, Hangzhou City, Zhejiang Province Patentee before: HANGZHOU DTWAVE TECHNOLOGY Co.,Ltd. |