講座(3)走進(jìn)大數(shù)據(jù)
1 大數(shù)據(jù)的概念與意義
1.從“數(shù)據(jù)”到“大數(shù)據(jù)”
時(shí)至今日,“數(shù)據(jù)”變身“大數(shù)據(jù)”,“開(kāi)啟了一次重大的時(shí)代轉(zhuǎn)型”。
“大數(shù)據(jù)”這一概念的形成,有三個(gè)標(biāo)志性事件:


2.大數(shù)據(jù)的技術(shù)支撐

大數(shù)據(jù)定義

1)存儲(chǔ):存儲(chǔ)成本的下降
存儲(chǔ)成本的下降,也改變了大家對(duì)數(shù)據(jù)的看法,更加愿意把1年、2年甚至更久遠(yuǎn)的歷史數(shù)據(jù)保存下來(lái),有了歷史數(shù)據(jù)的沉淀,才可以通過(guò)對(duì)比,發(fā)現(xiàn)數(shù)據(jù)之間的關(guān)聯(lián)和價(jià)值。正是由于存儲(chǔ)成本的下降,才能為大數(shù)據(jù)搭建最好的基礎(chǔ)設(shè)施。
2)計(jì)算:運(yùn)算速度越來(lái)越快
海量數(shù)據(jù)從原始數(shù)據(jù)源到產(chǎn)生價(jià)值,期間會(huì)經(jīng)過(guò)存儲(chǔ)、清洗、挖掘、分析等多個(gè)環(huán)節(jié),如果計(jì)算速度不夠快,很多事情是無(wú)法實(shí)現(xiàn)的。所以,在大數(shù)據(jù)的發(fā)展過(guò)程中,計(jì)算速度是非常關(guān)鍵的因素。
3)智能:機(jī)器擁有理解數(shù)據(jù)的能力
大數(shù)據(jù)帶來(lái)的最大價(jià)值就是“智慧”,大數(shù)據(jù)讓機(jī)器變得有智慧,同時(shí)人工智能進(jìn)一步提升了處理和理解數(shù)據(jù)的能力。例如:

3.大數(shù)據(jù)的意義

風(fēng)馬??上嗉?/span>
在大數(shù)據(jù)背景下,因海量無(wú)限、包羅萬(wàn)象的數(shù)據(jù)存在,讓許多看似毫不相干的現(xiàn)象之間發(fā)生一定的關(guān)聯(lián),使人們能夠更簡(jiǎn)捷、更清晰地認(rèn)知事物和把握局勢(shì)。大數(shù)據(jù)的巨大潛能與作用現(xiàn)在難以進(jìn)行估量,但揭示事物的相關(guān)關(guān)系無(wú)疑是其真正的價(jià)值所在。

2 大數(shù)據(jù)的來(lái)源


隨著人類活動(dòng)的進(jìn)一步擴(kuò)展,數(shù)據(jù)規(guī)模會(huì)急劇膨脹,包括金融、汽車、零售、餐飲、電信、能源、政務(wù)、醫(yī)療、體育、娛樂(lè)等在內(nèi)的各行業(yè)累積的數(shù)據(jù)量越來(lái)越大,數(shù)據(jù)類型也越來(lái)越多、越來(lái)越復(fù)雜,已經(jīng)超越了傳統(tǒng)數(shù)據(jù)管理系統(tǒng)、處理模式的能力范圍,于是“大數(shù)據(jù)”這樣一個(gè)概念才會(huì)應(yīng)運(yùn)而生。




3 大數(shù)據(jù)應(yīng)用場(chǎng)景




4 大數(shù)據(jù)處理方法





英文擴(kuò)展
So we constantly produce a lot of data, for example via social media public transport and GPS. But it goes way beyond that daily we upload 55 million pictures 340 million tweets and 1 billion documents in total we produce 2.5 quintillion bytes a day .That's a lot of zeros it's ridiculous we call this big data but what's actually more important is what you can do with it to process big data you don't need huge computers people work with the cloud and endless network of normal servers and powerful algorithms .This way they can analyze over a million pieces of data and minutes and the result well for example video streaming website Netflix analyzed the big data of their viewers like popular shows and watching patterns .This way they produced a successful series with the perfect combination of actors directors and storyline .Right now the big data of traffic is being analyzed to develop a car that can drive completely accident free all by itself and in the future we can even use the big data of DNA to determine the perfect treatment .This way curing genetic diseases like cancer would become much easier and that's just the start.
大數(shù)據(jù)時(shí)代
