Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

Website, DB, & Software Developers

TheMadMonk

(6,187 posts)

4. Because if you want petabytes of storage, you need...

Reply to Taverner (Reply #3)

Fri Feb 8, 2013, 04:54 AM

Feb 2013

...access speeds to match. Write times on these devices is often very slow.

It's doable, and being done. but it's not just a matter of grabbing 16000 x 32 GB thumb drive chips and cramming them into a box.

Nor will relying on ordinary RAID protocols, safeguard you against data loss. With SSDs, and a relatively fixed number of write cycles, it's quite probable that the backup device will fail within a very short timespan of the primary.

Edit history

Please sign in to view edit histories.

Recommendations

0 members have recommended this reply (displayed in chronological order):

14 replies

= new reply since forum marked as read

Highlight:

Would this work? Storage Device, SSD, 8PB for cheap? [View all] Taverner Feb 2013 OP

That is a "wafer" is a sheet with several 128GB SD chips on it Taverner Feb 2013 #1

Yes/No. Cost remains a huge factor. TheMadMonk Feb 2013 #2

Exactly, but say you didn't use SSDs but specifically cheap commodity HW? Taverner Feb 2013 #3

Because if you want petabytes of storage, you need... TheMadMonk Feb 2013 #4

Ahhh makes sense Taverner Feb 2013 #5

What about if you create multiple redunancies, not through RAID Taverner Feb 2013 #8

BTW...why couldn't you use RAID? Taverner Feb 2013 #10

Finite writes make this a problem, and you'll need a logical filesystem that will be a PITA Recursion Feb 2013 #6

What about Hadoop for the FS? Taverner Feb 2013 #9

Doesn't Hadoop rely on an underlying block FS? Recursion Feb 2013 #11

I don't know - but you could use Gluster for the FS Taverner Feb 2013 #12

How about this: format each SIM card with FAT or something similarly fast and stupid Recursion Feb 2013 #13

Hmmm I like that Taverner Feb 2013 #14

you're cool. Phillip McCleod Feb 2013 #7