Prevention for Crime Through Big Data

FBI Tools




AFIS(Automated Fingerprint Identificaiton System)

CODIS(Combined DNA Index System)

Crime prevention system at San Francisco

San Francisco open 100 bundle of data to the public such as crime, real estate. These data teach to the public that in San Francisco, violent crimes often occurs in the city center, narcotic crimes often occurs in the place occuring violent crimes. People obtain help from these meaningful information whether they live. In addition to this, by placing the police at potential crime occurrence place, San Francisco set up crime prevention system.

Free Conversation Through Big Data

Google translation 

Google make billions of sentences and translation into database by developing statistic technique inferencing similar sentences and phrase from database.

Baseball through Big Data

Money ball theory

Money ball is a game theory that it is possible to have a high winning rate by putting the right man in the right place based on only data analyzed previous game data.  

Its focus is the team's analytical, evidence-based, sabermetric approach to assembling a competitive baseball team, despite Oakland's disadvantaged revenue situation.

Election through Big Data

Obama in 2008

In the American presidential election, Barack hussein obama made 

"an election gimmick customized voter." At that time, Obama 

classified voter into race, religion, age, level of consumption and 

collect tendency such as whether a voter took a vote or not in the 

past, what magazine a voter subscribe, what beverage a voter drink 

through telephone call, personal visit and social media.Collected data 

was sent to head office of election camp and made various 

expectation helped by "VoteBuilder." Based on this, he made voter 

map. So, he electioneered effectively in a small amount of money.

Marketing through Big Data

Amazon.com

recommendation ad

Amazon.com register all customers' purchase list to the database, They grasp consumers' taste and interests by analyzing these records. The Amazon.com mark the recommendation through using these big data. They search consumers' hobbies or reading tendency in singles, they suggest automatically products which match up with him or her through mails and web site.

Google and facebook

customized ad

Google and Facebook manage instantly atypia data like images, videos and users' condition of searching. They use the way of Amazon.com's mark recommendation. and they in augment the big data's using.

Healthy Society through Big Data 2

DNA Link

DNA Link is a gene analysis system to offer people customized physical examination service. 

DNA Link is bio-venture company specializing in genome analysis and offering genome analysis and information analysis of every being and offer customized physical examination service. 

Personal genome analysis do the preparatory reseach for emotion of specific illness and side effect to deal with or prevent illness risk.

DNAGPS (Genomics Personalized Service)

H∞H Health care system

H∞H Healthcare offer customized health care service according to personal one's constitution. Through this system, it is possible to offer total health care service such as

prevention of diseases, management service of chronically ill anytime and anywhere.

Healthy Society through Big Data 1

Pillbox project 

 Pillbox project is opeated by National Institutes. Its purpose is to help people to identify an unknown pill. You can use this in internet site. http://pillbox.nlm.nih.gov/

If you access to this site, there are five box that you should fill out: Imprint, Shape, Color, Size, Scoring. If you fill out right answer, you can get information about your pill whether it is proper for you to take, what its use is and how long the pill last.

Google Flu Trends

A model using data from Google Flu Trends and weather 

forecasting techniques could predict the peak of flu out breaks in 

specific areas more than seven weeks in advance, according to 

researchers from Columbia University and the National Center for 

Atmosphere Research.

The Technology of Big Data 2 - GFS

b. GFS(Googld file system)

GFS is distributed file system developed by Google. GFS have come to the world after Google release 2 papers related to MapReduce. GFS form the basis of HDFS, one of the core elements of Hadoop.

The Technology of Big Data 1 - Hadoop

The amount of big data is very huge, infra technology for analyzing big data is need. Then what can be served as this infra technology for big data?

1. Technology related to Hadoop

The core technology of big data is Hadoop, the open source. Hadoop forms Hadoop ecosystem when it is developed by open source formation. To use Hadoop easily and make a connection with present system, there are Hadoop Animal Farm such as Pig, HBase, Sqoop, Flume and they are growing with rapid speed. From now on, I'm going to post Hadoop, Hadoop ecosystem and various technology of big data. Hadoop is a project for open source distributed processing technology. It is the most favorable solution
for analyzing present atypical or orthopedic big data. This technology is used by Yahoo, facebook and etc and
It is growing to adopt it. 




a. Hadoop

Hadoop creates clusters of machines and coordinates work among 
them. Clusters can be built and scaled out with inexpensive computers.

The Hadoop software package includes the robust, reliable Hadoop Distributed File System (HDFS), which splits user data across servers in a cluster. It uses replication to ensure that even multiple node failures will not cause data loss.

In addition, Hadoop includes MapReduce, a parallel distributed processing system that is different from most similar systems on the market. It was designed for clusters of commodity, shared-nothing hardware. No special programming techniques are required to run analyses in parallel using MapReduce; most existing algorithms work without changes. MapReduce takes advantage of the distribution and replication of data in HDFS to spread execution of any job across many nodes in a cluster.

Analysis Technique of Big Data 2

Cluster Analysis

Cluster Analysis is a technique defining similarity between changing data, calculate the distance between data and join together data in order of closeness between them. This technique is divided into hierarchical and non-hierarchical one.

Social Network Analytics 

Social Network Analyticsis a technique that extracts and analyzes the influence, interest, tendency and behavior pattern within personal or group’s social network. The representative one is sentiment analysis. It is the one that figure out emotion from atypical text data created within social network application. 

R

R is a search engine providing language and development environment for statistic computation and visualization.

Analysis Technique of Big Data 1

The processing of big data is demanded for quick decision making less than the present processing of data, but its complexity metric is very high. In addition, the amount of data to be processed is very big and atypical data is of great importance. It also has high flexibility of processing, analysis, but it is hard to process at the same time and it’s small in quantity of the amount of simultaneous processing. Therefore, the present analysis technique of data is unsuitable for analyzing big data., so new technique is required for analyzing big data.

Text Mining

Text Mining is based on Native Processing Technology that finds out value and meaning from the atypical text data. The user can extract meaningful information from enormous amount of information, figure out connectivity with other information and find out the category which the text has through this technique. In other words, it makes user get results more than simple information retrieval. The main field of technique dealt in Text Mining at present is Document Classification, Document Clustering, Information Extraction and Document Summarization, etc. 

Opinion Mining

Opinion Mining is a technique extracting reputation for product or service by collecting and analyzing consumer opinion from all of web documents and comment scattered in Internet such as SNS, blog, cafe, BBS, knowledge search. 

The Definition of Big Data

a. There is no correct anwser of the definition of big data. The following is defined from several enterprises.



Computer World

"Big data is information collected from computer system log file, electronic financial transaction, web searching stream, e-mail meta-data, social networking acitivities and etc."




Mckinsey

"Big data is a data which cannot be earned, saved, managed and analyzed by traditional database software."




Oracle

"Big data includes traditional enterprise data, data created by machine and social data."


Yahoo!

"Big data is unstructured data created by enterprise."




IDC 

"There are no standard which can judge whether it is big data or not. The size of big data is very extensive and it has a variety of structure, so it needs to be managed by a new technique to be acquired very quickly and analyzed. "





b. The difinition of big data devided by 3 aspects