The characteristics of big data are: large amount of data, many kinds of data, strong real-time requirements and great value contained in data. There are big data in all walks of life, but a lot of information and consultation are complex, which requires us to search, process, analyze, summarize and summarize its deep-seated laws.
Collection of big data: The development of technology and Internet has promoted the arrival of the era of big data, and all walks of life are generating massive data fragments every day. Data measurement units have developed from bytes, KB, MB, GB and TB to PB, EB, ZB, YB and even BB, NB and DB. Data collection in the era of big data is no longer a technical problem, but how to find its internal laws in the face of so much data.
Mining and processing of big data: Big data cannot be estimated by human brain, nor can it be processed by a single computer. It must adopt distributed computing architecture and rely on distributed processing, distributed database, cloud storage and cloud computing virtualization technology. Therefore, the mining and processing of big data must use cloud technology.