[HN Gopher] Filecoin: Proof of Storage Systems
       ___________________________________________________________________
        
       Filecoin: Proof of Storage Systems
        
       Author : simonebrunozzi
       Score  : 49 points
       Date   : 2020-08-19 19:08 UTC (3 hours ago)
        
 (HTM) web link (blog.coinlist.co)
 (TXT) w3m dump (blog.coinlist.co)
        
       | simonebrunozzi wrote:
       | > We created Filecoin because the amount of data humans generate
       | is exponentially increasing, and we need more efficient ways to
       | store and access it.
       | 
       | I don't think Filecoin can be MORE efficient than some of the
       | larger, current systems.
       | 
       | I actually think this statement is misleading. It should say that
       | Filecoin's goal is to offer storage options that are distributed
       | (hence redundant), protected from censorship, and possibly
       | removed from absolute control of a single large corporation.
        
         | RL_Quine wrote:
         | Almost by definition, it simply can not be more efficient.
        
           | rjeli wrote:
           | Assuming the FIL storage market is efficient, if the cost of
           | CPU time and energy to run PoRep is less than the premium
           | charged by commercial providers, it's more efficient. That
           | seems plausible to me.
        
             | TylerE wrote:
             | That's an awfully tall and teetering stack of assumptions.
        
           | geek_at wrote:
           | it can, if you're using microsoft storage spaces as software
           | raid
        
         | rudolph9 wrote:
         | There are a lot of nuanced ways a trustless distributed system
         | can be more efficient. The article is pretty light on details
         | but consider the content addressing mechanism. The data can be
         | securely served by any device and independently verified by any
         | recipient. The minimum latency of reads is theoretically much
         | lower than the sever/client infrastructure commonly used today.
         | It's like edge computing with any device that can connect to
         | one another. Obviously a lot goes into ensuring the data
         | existing on a low latency connection to the distributed-client
         | but the there are a number of somewhat nuanced theoretical
         | efficiencies that can be achieved by making content addressing
         | the core of a distributed system (caching, [as mentioned]
         | fault-tolerance, parallel computing, etc).
        
           | acdha wrote:
           | > The minimum latency of reads is theoretically much lower
           | than the sever/client infrastructure commonly used today.
           | 
           | This is an oversimplification: it assumes that discovery is
           | very low cost and that there's a peer with a copy enough
           | closer on the network that it's faster than talking to
           | server-class hardware in a data center with a high quality
           | network connection. Given the number of assumptions which
           | need to be true for that to be a net-positive I'm skeptical
           | that it'd be easy to hit anywhere close to the best-case
           | theoretical scenario.
        
           | zucker42 wrote:
           | Is this really an advantage of the fact that the system is
           | trustless and the ownership of storage media is distributed?
           | You can an imagine a system where Amazon owns all the hard
           | drive but still distributes/duplicates files across many
           | different hard drives, matching the theoretical performance
           | characteristics of Filecoin. In fact storing data on S3 from
           | my cursory understanding already distributes data across
           | multiple drives based on their durability claims.
        
         | fsflover wrote:
         | It can be more efficient if you are using thousands/millions of
         | hard drives which otherwise would just be unused.
        
           | Taek wrote:
           | This story falls apart a bit with Filecoin because you need
           | to attach them to 128 GB of RAM and a high end graphics card
           | to do their storage proofs.
           | 
           | Secondary markets for drives may appear to close the gap a
           | bit though.
        
       | mdaniel wrote:
       | By chance, I saw a relevant article over on r/ipfs:
       | https://www.axios.com/filecoin-blockchain-delay-3b5e6b9a-bcc...
        
         | wmf wrote:
         | Discussed yesterday:
         | https://news.ycombinator.com/item?id=24199595
        
       | cgb223 wrote:
       | How is Filecoin different from Sia coin?
       | 
       | I remember a while ago hearing about both trying to decentralize
       | storage but never kept up with it enough to really suss out the
       | difference
        
         | Sargos wrote:
         | Sia seems like a Dropbox/OneDrive replacement whereas Filecoin
         | is an incentivized storage layer infrastructure for apps to
         | use, especially dapps.
         | 
         | If you wanted to build a decentralized SoundCloud you couldn't
         | use Sia but IPFS/Filecoin is the primary building block of such
         | a dapp.
        
           | olah_1 wrote:
           | Sia released a new version of their product called Skynet[1]
           | which provides exactly the functionality of IPFS+Filecoin
           | today. Part of Skynet is a group of SDKs[2] which you can use
           | to integrate skynet storage as part of your application. I
           | believe that they are even adding the ability for developers
           | to get kickbacks if they build on Sia[3].
           | 
           | If you do want something like Dropbox that is built on Sia,
           | there is Filebase[4].
           | 
           | I am not associated with Sia at all. I've just been following
           | their twitter for a while.
           | 
           | [1]: https://siasky.net/
           | 
           | [2]: https://nebulouslabs.github.io/skynet-docs/#introduction
           | 
           | [3]: https://twitter.com/SiaTechHQ/status/1291441690008592384
           | 
           | [4]: https://docs.filebase.com/
        
         | olah_1 wrote:
         | My 2 cents is that they just have different methodologies
         | driving them. Sia is shipping a working network early and
         | updates are arriving often.
         | 
         | Filecoin seems to be taking an approach more like Holochain
         | stuff. Meaning they are shipping early and often but only
         | internally and you'll get to see it when its ready(tm).
        
       | mifeng wrote:
       | This article seems like it was written in 2017, not 2020.
       | 
       | Filecoin raised over $200m and hasn't shipped anything that I'm
       | aware of in 3 years. Maybe it will be revolutionary, but the
       | crypto industry has long moved on from white whale projects that
       | don't ship.
        
         | wmf wrote:
         | https://github.com/filecoin-project/lotus
         | 
         | https://docs.filecoin.io/how-to/install-filecoin/
        
         | hinkley wrote:
         | Going from zero to a positive velocity takes a certain kind of
         | person who doesn't let doubts stop them.
         | 
         | But to build a team around a project? You can hack a lot of
         | stuff together than only makes sense to you, crippling any of
         | your would-be collaborators. Certain kinds of doubts should in
         | fact stop you, or at least slow you down. It's a difficult
         | thing to balance, and most of us struggle to pull it off.
         | 
         | I tried to help out with Freenet years ago. The code was in a
         | language I had quite a lot of deep knowledge about, I should
         | have been able to help quite a bit, but I ended up sticking to
         | specs and architecture.
         | 
         | Bluntly, the code was not the output of an organized mind. Even
         | though most of it was written by one person. It ping-ponged all
         | over. The prototype was already full of esoteric optimizations
         | that sacrificed clarity (and thus correctness) for a little
         | more speed. Major rafts of functionality were still being
         | designed, and it was already work-hardened.
         | 
         | When I see a team ramp up and get wedged, my first questions
         | are about code quality, practices, and team dynamics. About
         | cohesion. Too often the old guard can't delegate, even if they
         | want to. With enough tribal knowledge, your coworkers just
         | start to get interesting, and then they move on to a new job,
         | and you replace them with another person who struggles to
         | accomplish even simple things.
         | 
         | Or even worse, they made a promise that Information Theory says
         | they can't keep, and they've been bargaining the entire time.
         | It's a terrible place to be.
        
       | mdaniel wrote:
       | That is not what matches my mental model of a "deep dive," but
       | was interesting enough to warrant an upvote
       | 
       | For example, the phrase "decentralized marketplace of storage
       | providers and choose the one" was just glossed over -- through
       | what mechanism does one choose a storage provider? Is there an
       | API that (for example) a container storage interface provider
       | could consume? like that kind of "choose a provider"?
       | 
       | I also would have enjoyed more hyperlinks for terms such as zk-
       | SNARK, and "a storage miner" which is similarly glossed over
        
         | dang wrote:
         | Ok, we'll swap a prefix for a suffix of the title above.
         | 
         | (Submitted title was "Deep Dive into Filecoin".)
        
         | momack2 wrote:
         | You may enjoy this HackFS Workshop from Juan Benet (creator of
         | Filecoin) that starts pretty high level but gets much more into
         | the details of how the Filecoin network works:
         | https://www.youtube.com/watch?v=P28aNAdZDi4
        
       | ironchief wrote:
       | This hardly meets the definition of brief description, let alone
       | a "Deep Dive".
        
         | hacker_newz wrote:
         | That's par for the course working with filecoin.
        
       | zepearl wrote:
       | General question:
       | 
       | when somebody will push into Filecoin some "bad" files (anything,
       | from docs needed by the mafia to children being sexually abused,
       | to fake videos/claims/whatever about you, to any other bad things
       | you can think of), how can that be detected and then deleted?
       | (ignoring here the theme related to accountability)
       | 
       | Question based on https://docs.filecoin.io/introduction/why-
       | filecoin/ :
       | 
       |  _Filecoin resists censorship because there is no central
       | provider that can be coerced into deleting files or withholding
       | service. The network is made up of many different computers run
       | by many different people and organizations. Faulty or malicious
       | actors are noticed by the network and removed automatically._
       | 
       | In this context I'm not a believer of "automatically".
        
         | yorwba wrote:
         | In this context, "faulty and malicious actors" would be those
         | who interfere with the operation of the network, e.g. by
         | deleting files they consider "bad".
        
         | acdha wrote:
         | I generally phrase this as "How is this safer than running a
         | Tor exit node?". If someone uploads illicit material to Amazon,
         | they have enough lawyers & clout to have the FBI send them a
         | letter demanding client information. If this is a peer-to-peer
         | service, you have a non-zero risk that the SWAT team is going
         | to show up at your home/office and demand you prove that you
         | weren't aware of that content. That's going to deter a LOT of
         | people.
        
       ___________________________________________________________________
       (page generated 2020-08-19 23:01 UTC)