[HN Gopher] Show HN: Rendering One Million Datapoints with D3 an... ___________________________________________________________________ Show HN: Rendering One Million Datapoints with D3 and WebGL Author : ColinEberhardt Score : 132 points Date : 2020-05-02 07:01 UTC (15 hours ago) (HTM) web link (blog.scottlogic.com) (TXT) w3m dump (blog.scottlogic.com) | gdubs wrote: | The scatterplot of the library data is fascinating -- looks like | an organism. | paulgb wrote: | Scott Logic is probably the highest-quality company technology | blog I've encountered in a while. I keep returning to it for | WebAssembly and WebGL topics and it is consistently high quality. | I'm not even sure what Scott Logic does, but they sure know their | stuff :) | | Kudos, Colin and team. | onion2k wrote: | Their head office is round the corner from my office in | Newcastle, UK, and I occasionally bump in to their devs in the | local pub and at the JS meetup. They're very good at what they | do and lovely people too. | luhem7 wrote: | https://www.scottlogic.com/what-we-do/ | | ;) | 1wheel wrote: | Nice write up Colin! | | fwiw quadtrees don't make much sense when you're showing a | tooltip for ~1 million points: https://roadtolarissa.com/scan- | sorted/ | zylepe wrote: | Very cool! I've done visualizations on similar size datasets by | mapping tsne output to fake latitude/longitude coordinates and | rendering it with mapbox gl. It feels like a hack, but then you | get all of the panning/zooming interaction, styling, and | rendering labels with collision avoidance for free. For smaller | datasets I pass in geojson directly, but for larger ones I | precompute vector tiles so you can lazy-load more of the data | when you zoom in. There are a lot of things built for mapping | that are relevant for other domains, I wish that there was a | common base that could be extracted that mapping libraries adapt | to geographic data but data visualizations could adapt to non- | geographic data. | | I'll have to play around with your technique more, encouraging to | see you get good performance eagerly loading a million data | points! | 7373737373 wrote: | I can recommend LargeVis[0][1] which I used to layout and | Polymaps[2] to visualize tiles of the https://wikiscape.org | article point cloud. | | [0] https://github.com/lferry007/LargeVis [1] | https://github.com/elbamos/largeVis [2] http://polymaps.org/ | andybak wrote: | Deck.GL has some similar examples. I think the reason this | makes sense is that geo data viz had to pioneer huge datasets - | which are less common in other fields. ___________________________________________________________________ (page generated 2020-05-02 23:00 UTC)