A Simple Definition of Big Data.
Big Data is the analysis of huge set of information to identify trends, patterns, and correlations between outcomes of different sources, in order to form a conclusion of what will happen next in near real time. This huge set of information is highly disseminated, unstructured, and streaming in real time (this is not information that can be analysed after the fact).
5 Best Big Data Quotes
“You can have data without information, but you cannot have information without data.”
“Without big data, you are blind and deaf in the middle of a freeway.”
“Big data is at the foundation of all the megatrends that are happening today, from social to mobile to cloud to gaming.”
“There were 5 exabytes of information created between the dawn of civilization through 2003, but that much information is now created every 2 days.”
“Hiding within those mounds of data is knowledge that could change the life of a patient, or change the world.”
An Equally True Statement About Big Data
"The amount of nonsense that can be packed into the term 'Big Data' doubles approximately every two years."
Interesting Big Data Facts and Figures
Check out the Infographics for more Big Data facts and figures.
How Data Has Changed Over Time.
Data used to be perceived as static information, whose usefulness was finished once the purpose for which it was collected was achieved. Today, data had become a raw material of business, a vital economic input, used to create new form of economic value. In fact, data can be cleverly reused to enable innovation and new services. Data can reveal secrets to those with the right mindset and tools to listen.
When Location Becomes Data
Think for a moment when someone said "I was in Paris on 30th September 1930". In olden days, this statement was said to have 2 information, with only one of them could be quantified - date. Today, this statement has 2 quantifiable information - location and date. With the introduction of the Universal Transverse Mercator (UTM) coordinate system in the 1940s, location could then be recorded in a standardised numerical format. When a GPS receiver is attached to an object - human or otherwise, the object can be tracked to produce information about location, date, and time of the object, making it a very useful piece of data to be exploited. With wireless sensors installed in so many devices, equipment, machinery, vehicles and the like, location information relating to an object is increasing at exponential rate. The analysis of Big Data now includes location information and other data such as temperature, humidity, wind speed / direction, and UV level relating to a location.
Is There Small Data Before Big Data?
Everything grows from small to big, including data. Therefore, there is Small Data that is usually used to describe data whose volume and format can be easily used for self-service analytics (to be explained below). A commonly quoted axiom is that "Big Data is for machines. Small Data is for people". Small Data is often organised and packaged, readily accessible, understandable, and actionable for everyday tasks. Examples of Small Data include sales data, weather forecasts, fuel consumption history, sports results, and telephone directory.
Self-service analytics is a process where business users perform advanced analytics by manipulating data to identify
business opportunities, without requiring them to have a background in statistics or technology.
Software vendors are introducing products that allow business users to work with data aggregated from a range of sources. The software provides users with a dashboard that allows the users to query and manipulate large amounts of data. In the past, such data analysis was solely the domain of trained data analysts, who are now often referred to as data scientists.
The 3 Significant Shifts in Dealing with Data
Due to the emergence of Big Data, there has been some significant shifts away from how we deal with data (Big Data vs Small Data):
In the past, we relied on using sample to form a conclusion about the population. Today, we can analyse far more data than before.
When we analyse ALL the data, we can see details that could not be observed by sampling.
Big Data gives us the chance to see data within data.
Analysing more data permits us to relax on exactitude.
In a small data environment, we analyse and quantify as precisely as possible.
With big data, we are satisfied with a sense of general direction rather than knowing the exact element of a phenomenon.
What we lose in accuracy at the micro level is what we gain in insight at the macro level.
When dealing with Big Data, we move away from age-old seach for causality - a human nature to search for causes.
Instead of looking for causes, we are satisfied with patterns and correlations in the data that provide us with unprecedented insights.
The correlations may not tell us precisely why something is happening, but they affirm that it is happening.
What is Open Data?
The term “open data” refers to non-proprietary and machine-readable data that anyone is free to use, reuse, manipulate, and disseminate without legal or technical restrictions. The first open government data policy was launched in Washington, D.C. in 2008, when the Chief Technology Officer of the District of Columbia released on the Internet more than 400 datasets on the District’s budget, contracts, crime statistics, and more. Developers were encouraged to manipulate, repurpose, and integrate these datasets, creating new applications free for all to use. When President Barack Obama entered office in 2009, he endorsed a similar initiative at the federal level, requiring federal agencies and departments to release open datasets to a designated website, Data.gov.
See our compilation of resources on Open Data here and there.
Merry Christmas & Happy New Year 2018
FEATURED BIG DATA EVENTS
Corporate Parity offers special price when you quote promotion code in Registration Form. Please request for one from firstname.lastname@example.org.
Click here to see more events.
The RFX Lab is a R&D lab from Vietnam, we build the innovating open source framework for real-time analytics or fast data problems.
We are reseller of 5 products and services. Find out more here .
FEATURED ONLINE COURSES
FEEL LIKE FINDING A BOOK ON BIG DATA?
TOP 10 PICKS BY OUR TEAM
Big Data by Country
We share some good websites in each country that show their commitment in Big Data initiatives, whether they are by governments, organisations, or even individuals.
> South Korea
Are you from a country that has ambitious Big Data initiatives that you would like to add? Please contact us.
> More links to datasets have been added.
> More case studies have been added.
> New Open Data links have been added.
> Exclusive articles on Big Data and MH370.
> BDS:BDA Learning Portal has been launched.
> BDS achieves another milestone in June 2017 -
it is now a reseller of MailGuard products and
> See Milestones achieved by BDS.
> Micro Data Hub has been launched to share
IF YOU LIKE THIS WEBSITE AND ITS CONTENT, PLEASE MAKE A DONATION OF ANY AMOUNT AT >>>