Different companies have different contents, which are roughly as follows: First, design and implement the basic framework and functional components of the data platform, such as unifying the front and rear basic components, configuration and authority management, data source access, task scheduling, job management, search and so on.
Secondly, the technical scheme of data intermediate platform (DevOps) for R&D, operation and maintenance is designed and implemented. Then it is responsible for the optimization, daily operation and monitoring of the data platform to support business stability. Finally, optimize the architecture of governance data platform, and design, develop and deploy micro-services.
Introduction:
Big data analysis refers to the analysis of massive data. Big data can be summarized into five V's, which are large, fast, diverse, valuable and true.
As the hottest word in IT industry, big data is followed by data warehouse, data security, data analysis, data mining, etc., which has gradually become the profit focus that industry people are scrambling to chase. With the advent of the era of big data, big data analysis came into being.