[HN Gopher] Show HN: Rendering One Million Datapoints with D3 an...
       ___________________________________________________________________
        
       Show HN: Rendering One Million Datapoints with D3 and WebGL
        
       Author : ColinEberhardt
       Score  : 132 points
       Date   : 2020-05-02 07:01 UTC (15 hours ago)
        
 (HTM) web link (blog.scottlogic.com)
 (TXT) w3m dump (blog.scottlogic.com)
        
       | gdubs wrote:
       | The scatterplot of the library data is fascinating -- looks like
       | an organism.
        
       | paulgb wrote:
       | Scott Logic is probably the highest-quality company technology
       | blog I've encountered in a while. I keep returning to it for
       | WebAssembly and WebGL topics and it is consistently high quality.
       | I'm not even sure what Scott Logic does, but they sure know their
       | stuff :)
       | 
       | Kudos, Colin and team.
        
         | onion2k wrote:
         | Their head office is round the corner from my office in
         | Newcastle, UK, and I occasionally bump in to their devs in the
         | local pub and at the JS meetup. They're very good at what they
         | do and lovely people too.
        
         | luhem7 wrote:
         | https://www.scottlogic.com/what-we-do/
         | 
         | ;)
        
       | 1wheel wrote:
       | Nice write up Colin!
       | 
       | fwiw quadtrees don't make much sense when you're showing a
       | tooltip for ~1 million points: https://roadtolarissa.com/scan-
       | sorted/
        
       | zylepe wrote:
       | Very cool! I've done visualizations on similar size datasets by
       | mapping tsne output to fake latitude/longitude coordinates and
       | rendering it with mapbox gl. It feels like a hack, but then you
       | get all of the panning/zooming interaction, styling, and
       | rendering labels with collision avoidance for free. For smaller
       | datasets I pass in geojson directly, but for larger ones I
       | precompute vector tiles so you can lazy-load more of the data
       | when you zoom in. There are a lot of things built for mapping
       | that are relevant for other domains, I wish that there was a
       | common base that could be extracted that mapping libraries adapt
       | to geographic data but data visualizations could adapt to non-
       | geographic data.
       | 
       | I'll have to play around with your technique more, encouraging to
       | see you get good performance eagerly loading a million data
       | points!
        
         | 7373737373 wrote:
         | I can recommend LargeVis[0][1] which I used to layout and
         | Polymaps[2] to visualize tiles of the https://wikiscape.org
         | article point cloud.
         | 
         | [0] https://github.com/lferry007/LargeVis [1]
         | https://github.com/elbamos/largeVis [2] http://polymaps.org/
        
         | andybak wrote:
         | Deck.GL has some similar examples. I think the reason this
         | makes sense is that geo data viz had to pioneer huge datasets -
         | which are less common in other fields.
        
       ___________________________________________________________________
       (page generated 2020-05-02 23:00 UTC)