- Home
- Member
- tatsuya
- tatsuya's entries
- Does Moore's law hold true for Big Data
Does Moore's law hold true for Big Data
- 583
- 11
- 5
About one week ago I read an article on Big Data, which is a 'Next Big Thing' in the IT field.
Big Data's Impact in the World - NYTimes.com
http://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-the-world.html
In this article the following statement appeared:
"There is a lot more data, all the time, growing at 50 percent a year, or more than doubling every two years, estimates IDC, a technology research firm."
The phrase "doubling every two years" reminded me of Moore's law.
Do you know Moore's law? Moore's law describes a long-term trend in computer hardware, such as memory and processor. It is called a law, but actually it is an empirical rule rather than a proven scientific law. It is named after Dr. Moore who is a Intel co-founder. He stated the law in his paper published in 1965.
Moore's original statement was that transistor counts on a integrated circuit had doubled every year. Then the statement extended to a number areas related to integrated circuits. For example, the memory capacity doubles every year since the capacity of a memory is proportional to the number of transistors on it. Currently performances of digital electronic devices, such as processing speed, memory capacity, network bandwidth and so on, are considered to go along with Moore's law.
Do not underestimate the exponential nature of Moore's law. "Doubling every two years" means "4 times every 4 years", "8 times every 6 years", "16 times every 8 years", "32 times every 10 years", ..., "1024 times every 20 years", ..., "1048576 times every 40 years" and so on. Assume that a computer had a memory of 1K byte (1024 byte) 40 years ago. With "doubling every two years" it becomes 1048576K byte (about 1GB) now.
Moore's law
http://en.wikipedia.org/wiki/Moore%27s_law
The article above said data grows according to Moore's law. But wait. Moore's law is to be applied only to hardware. I wondered whether it holds true for data.
Then I remembered another law: Parkinson's law:
http://en.wikipedia.org/wiki/Parkinson%27s_law
The original Parkinson's law is:
"Work expands so as to fill the time available for its completion."
It says that work never finishes before the deadline. I always experience it. Then it is extended to other resources. A Corollary is:
"Data expands to fill the space available for storage."
Yes, my Mac keeps complaining that "Start Up Disk is Almost Full."
Now I've got everything.
Moore's law: Storage doubles every two year.
Parkinson's law: Data expands to fill the space available for storage.
Combining the two laws together we get:
Data expands to fill the space available for storage that doubles every two year.
This leads the following:
Big Data's law: Data doubles every two year.
Big Data's Impact in the World - NYTimes.com
http://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-the-world.html
In this article the following statement appeared:
"There is a lot more data, all the time, growing at 50 percent a year, or more than doubling every two years, estimates IDC, a technology research firm."
The phrase "doubling every two years" reminded me of Moore's law.
Do you know Moore's law? Moore's law describes a long-term trend in computer hardware, such as memory and processor. It is called a law, but actually it is an empirical rule rather than a proven scientific law. It is named after Dr. Moore who is a Intel co-founder. He stated the law in his paper published in 1965.
Moore's original statement was that transistor counts on a integrated circuit had doubled every year. Then the statement extended to a number areas related to integrated circuits. For example, the memory capacity doubles every year since the capacity of a memory is proportional to the number of transistors on it. Currently performances of digital electronic devices, such as processing speed, memory capacity, network bandwidth and so on, are considered to go along with Moore's law.
Do not underestimate the exponential nature of Moore's law. "Doubling every two years" means "4 times every 4 years", "8 times every 6 years", "16 times every 8 years", "32 times every 10 years", ..., "1024 times every 20 years", ..., "1048576 times every 40 years" and so on. Assume that a computer had a memory of 1K byte (1024 byte) 40 years ago. With "doubling every two years" it becomes 1048576K byte (about 1GB) now.
Moore's law
http://en.wikipedia.org/wiki/Moore%27s_law
The article above said data grows according to Moore's law. But wait. Moore's law is to be applied only to hardware. I wondered whether it holds true for data.
Then I remembered another law: Parkinson's law:
http://en.wikipedia.org/wiki/Parkinson%27s_law
The original Parkinson's law is:
"Work expands so as to fill the time available for its completion."
It says that work never finishes before the deadline. I always experience it. Then it is extended to other resources. A Corollary is:
"Data expands to fill the space available for storage."
Yes, my Mac keeps complaining that "Start Up Disk is Almost Full."
Now I've got everything.
Moore's law: Storage doubles every two year.
Parkinson's law: Data expands to fill the space available for storage.
Combining the two laws together we get:
Data expands to fill the space available for storage that doubles every two year.
This leads the following:
Big Data's law: Data doubles every two year.
Latest entries
| A Busy Day (4) |
| How To Kill Time At Shinjuku (6) |
| Levon Helm - My Image Of America (2) |
| Coursera - One More Online Education Venture (5) |
| My 100th Entry (20) |
Latest comments
| May 09th 詠美 |
| Apr 24th may382 |
| Apr 24th Lindsay |
| Apr 24th cuavsfan |
| Apr 24th cuavsfan |
Entries by Month
| 2012 |
|---|
| April (23) |
| March (31) |
| February (29) |
| January (21) |
Does Moore's law holds true for Big Data?
Moore's law describes a long-term trend in the computer hardware, such as memory and processor.
Moore who is a an Intel co-founder.
He stated the this law in his paper published in 1965.
"holds" is incorrect -- as this would imply a plural subject.
thank you Jameserb ^^
Moore's law: Storage doubles every two years.
Data expands to fill the space available for storage that doubles every two years.
This leads to the following:
Big Data's law: Data doubles every two years.
I haven't read the article yet, though, so I don't know what kind of data is mentioned in it. Great blog post. Are you a programmer?
Anyway, the latter half of this entry is a kind of a joke because Parkinson's law is a such thing. Please don't take it seriously. It is not a true logic.
Yes, I write programs but I'm not a professional programmer. I'm a teacher.
Does Moore's Law Hold True for Big Data
About one week ago I read an article about big data, which is a 'Next Big Thing' in the IT field.
Moore's law describes a long-term trend in computer hardware such as memory and processors.
Moore who is an Intel co-founder.
He stated the law in his paper that was published in 1965. ["newspapers publish stories", while "articles are published". Therefore, you need passive voice. (1) use the relative pronoun, "that". (2) the antecedent for "that" is "paper". (3) substitute "paper" for "that" --> "paper was published". and this is the passive voice in the formal of a relative clause.]
Moore's original statement was that transistor counts on a integrated circuit had been doubling every year.
For example, the memory capacity doubles every year since the capacity of memory is proportional to the number of transistors on it.
Currently, the performance of digital electronic devices that rely on things such as processing speed, memory capacity, network bandwidth and so on, are considered to follow Moore's law. ["Devices" are not "speed", "capacity", "bandwidth", etc. "Devices" are iPads, routers, dram, etc.]
"Doubling every two years" means "4 times every 4 years", "8 times every 6 years", "16 times every 8 years", "32 times every 10 years", ..., "1024 times every 20 years", ..., "1,048,576 times every 40 years" and so on.
With "doubling every two years" it has become 1,048,576K byte (about 1GB) now.
The article above says data grows according to Moore's law.
A corollary is:
Moore's law: Storage doubles every two years.
Data expands to fill the space available for storage that doubles every two years.
This leads to the following:
Big Data's law: Data doubles every two years.
"Too much data masks the signal with noise."
I think it is totally different situation when hiding something by adding a lot of noises intentionally.
Content mill is another headache of Google.
About one week ago I read an article on Big Data, which is "the next big thing" in the IT field.[comment: "the next big thing" is an idiomatic phrase -- it doesn't have to be set in quotation marks, but it is not correct to do so.
The law is named after a co-founder of Intel, Gordon Moore.[comment: use full names (if you know them) the first time they are referenced. Also, note how rearranging the phrases "an intel co-founder" and "Gordon Moore" puts the most important idea (Gordon Moore's name) at the end.]
He articulated this law in a paper published in 1965.[comment: one doesn't state a law -- especially if one is the creator of the law. Also, note that if Moore is articulating the law it is clear that he published the paper, so no additional pronoun is needed]
Moore's original statement was that transistor counts on a integrated circuit had doubled every year.Moore's original statement was that the number of transistors on an integrated circuit doubles approximately every year.[comment: since this is a law valid for the present and future, use the present tense "the number of transistors double"]
Then the statement extended to a number areas related to integrated circuits.>> This statement has since been extended to several areas related to integrated circuits.
Consider that a computer had just 1 kilobyte of memory (1024 byte) 40 years ago.
Moore's law is to be applied only to hardware.Moore's law, as he originally defined it, applies only to hardware.[comment: "is to be applied" implies that the human application of the law must follow some rules. It is not incorrect to say this, but "the law applies" is more direct and focuses on the original intent of the law.
I hope you understand the fine point I make between "is to be applied" and "applies".
Best,
James
My understanding is:
Using "applies" states a fact that the "original" law always applies only to hardware. This statement does not involve the human who applies the law. While "is to be applied" talks about the human behavior. It means people should apply the law only to hardware.
Is it right?
Then the statement extended to a number of areas related to integrated circuits.
I always experience this law.
This entry reminded me of Hofstadter's Law:
It always takes longer than you expect, even when you take into account Hofstadter's Law.
http://en.wikipedia.org/wiki/Hofstadter%27s_Law
It's funny.
Actually I read "Gödel, Escher, Bach" a long time ago, but maybe I forgot the contents.
Self referencing things are always interesting. I love recursion.