What is big data and how to understand it in the era of big data?

The definition of big data

Bigdata is usually used to describe a large amount of unstructured and semi-structured data created by a company. It will take too much time and money to download it to a relational database for analysis. Big data analysis is often associated with cloud computing, because real-time analysis of large data sets requires a framework such as MapReduce to distribute work to dozens, hundreds or even thousands of computers.

Characteristics of big data

There are a lot of data, many kinds of data, strong real-time requirements and great value contained in the data. There are big data in all walks of life, but a lot of information and consultation are complex and need to be searched, processed, analyzed, summarized and summarized.

The influence of the era of big data

More and more governments, enterprises and other institutions are beginning to realize that data is becoming the most important asset of the organization, and data analysis ability is becoming the core competitiveness of the organization. For example, on March 22, 20 12, the Obama administration announced that it would invest 200 million US dollars to promote the development of big data-related industries and raise the "big data strategy" to the national will. In 20 12, the United Nations also published the White Paper on Big Data Government, pointing out that big data is a historic opportunity for the United Nations and governments around the world. People can now make use of extremely rich data resources to make unprecedented real-time analysis of social economy and help the government to better cope with social economic operation.

The Significance and Prospect of Big Data

Big data is a huge, dynamic and sustainable data, which can be mined by using new systems, new tools and new models, so as to obtain something with insight and new value. In the past, faced with huge data, we may be blind, so we can't understand the true nature of things, so we will draw wrong inferences in scientific work. With the advent of the era of big data, all the truths will be presented to everyone.

The purpose of big data analysis

The core purpose of big data analysis is to predict, on the basis of massive data, predict the possibility of things through various technologies and mathematical modeling related to machine learning, and take corresponding measures. Forecast stock price, forecast air ticket price, forecast flu, etc.

If we predict the possibility of things happening, we can guide things to develop in the expected direction through appropriate intervention. For example, Amazon, like all e-commerce, will recommend products based on the analysis of user preferences and spending power, and guide users to increase the amount of consumption; Internet giants such as Google will also try to show different advertisements to different users through various technical means, and call it precision marketing to improve the click-through rate (company income); Online game companies will also adjust the design of game levels and charging points in time through the analysis of player behavior data in operating projects.