[HN Gopher] Internet Archive announces new Open Library Explorer... ___________________________________________________________________ Internet Archive announces new Open Library Explorer (beta) Author : mekarpeles Score : 110 points Date : 2020-12-21 18:27 UTC (4 hours ago) (HTM) web link (blog.openlibrary.org) (TXT) w3m dump (blog.openlibrary.org) | musicale wrote: | It never ceases to amaze and dismay me how we've built the | greatest library in human history, one with intrinsic properties | of unlimited readers per book, negligible distribution cost, and | minimal barriers to access, and then done our best to sabotage | those properties. | | Since the typically imposed access barriers are based on | copyright law, the situation could be improved somewhat by: | | a) reforming copyright law to allow orphan works to enter the | public domain, and | | b) enabling authors to (easily) add creative commons licenses | (minimally something like CC BY-NC-ND) permitting unlimited | readers in digital libraries. | jabo wrote: | Great work @mekarpeles and team! | | I'm working on an open source alternative to Algolia called | Typesense (https://github.com/typesense/typesense) and just this | last weekend I built an Instant Search experience using the 28M | Open Library books data set and Typesense: | | https://books-search.typesense.org/ | superkuh wrote: | I am impressed and happy to see Open Library works without | Javascript. Thanks for considering the dozens of us. It's totally | reasonable not to have "Explorer" work since it sounds like an | application and not a document. And even in that case the links | and search still show up so it falls back well. | edlinfan wrote: | This is a wonderful tool and goes a long way to scratch the | "library itch" I've felt since the start of the pandemic. | Projects like this make me very happy that I donated to IA this | year, and I'd encourage anyone else who likes them to do the | same. | | One question: are there any plans to sort fiction by author, | similar to what is done in real libraries? A lot of fiction is | already available in this tool, filed under DDN 8xx, but the | groupings are pretty broad. | mekarpeles wrote: | This is a great idea. One of the reasons Open Library Explorer | is possible is we have a healthy amount of Dewey + Library of | Congress classification data for our books. As you notes, Dewey | has Literature 8xx. Library Explorer also supports Library of | Congress (you can go to the settings cog and change the | classification system). | | Some classifications (LCCN) are better at encodind Author data | and we also have a significant amount of author data in Open | Library (we'd just need to integrate it more meaningfully in | our search index). | | I opened an issue for you here: | https://github.com/internetarchive/openlibrary/issues/4319 | | Given our small team size, not sure we'll have the bandwidth to | prioritize any time soon, but contributions are also welcome | from the community and we (the community) meet every Tuesday @ | 11:30am to discuss and unblock together. | sundarurfriend wrote: | The article tries in several paragraphs to explain the experience | of using it - I'd recommend instead just clicking on the Library | Explorer link[1] yourself and actually experiencing it yourself. | | There's something to be said for these physical-world-analogue | UIs, in my opinion. Even if this is technically the same | affordance as provided by old school web directory UIs, there's | more of a sense of tangibility and immediacy to this kind of | visual presentation, that makes it more appealing and easier to | spend longer times in. | | [1] https://openlibrary.org/explore | mekarpeles wrote: | Updated the article to include a shiny "try it here" link at | the top based on your feedback, thank you. | mrspeaker wrote: | One bit of "meta" feedback from me: I love Open Library, but | I get stuck every time I read one of the blog posts - because | there's no link to the actual library! I always hunt for it | for a while and eventually have to go up to the url and | manually remove "blog." and the rest of the blog page | parameters. | | Maybe I'm just missing it? But the big "Open Library" icon is | not clickable, and even the "about" page doesn't seem to have | a link to openlibrary.org. | mekarpeles wrote: | https://openlibrary.org/explore | | Do try out the "Settings" cog at the bottom of the UI -- one | thing that makes this interface so powerful is you can add custom | queries to transform the entire library (such as to only show | kids books, text books, or biographies on any subject). | cratermoon wrote: | As cool as this is, I think it would be worth your while to look | up Clay Shirky's "Ontology is overrated" if you can find it, or | watch his talk https://youtu.be/ujMgQqp8YSY?t=1118 | cdrini wrote: | Thank you for trying the Library Explorer :) Very interesting | talk! Personally, I don't think anything there is a testament | for abandoning classification trees entirely; just "common | pitfalls" to avoid when building new ones. The Library Explorer | is very purposefully classification-system agnostic, so if a | better classification system comes along, we can import it and | switch to it! And unlike a physical library, we don't have any | re-shelving costs :) | | One of the core design features I was aiming for with Library | Explorer was that the user should never be navigating the | "hierarchy;" they should be navigating the books. Forcing the | user to move through categories forces them to try to | understand the hierarchy, which can at times be not super user- | friendly. Note that the Yahoo/Google examples in the video do | just that; the user picks a class, and then sees websites. By | showing them the books directly, the user "deduces" the | classification tree (lots of books about physics? I must be in | the physics section); the classification labels aren't really | necessary for exploration. | | In general, I think there are trade-offs. A classification tree | is a model with flaws (just like all models). But its core | benefits are (1) it's a tree; so each node has semantic | siblings, parents, and children; (2) each node in the tree has | a finite number of child nodes (and usually <30 child nodes; | which makes it ideal for human traversal); (3) each book can be | uniquely identified by the path from the root. (3) Was very | important for physical librarians (classification systems were | sort of like a search index for librarians), and was the cause | of some of the issues described by Shirky. But online, we don't | need (3), so we can kind of throw it away. The tree can be | degenerate; books can (and do!) appear in multiple nodes of the | classification tree, because, unlike in a physical collection, | in a digital collection, books are disjointed from the | classification tree itself. | | Tag-clouds are _definitely_ more flexible (as Shirky said, | classification trees are a _restriction_ on the tag-cloud | model), but come at a cost of being harder to navigate (as | flexibility usually does) and get a "big picture" idea of. I | haven't seen a good example of a UI that lets you navigate tags | in a way that doesn't just let you travel from one node to a | neighbouring node (please post if folks have one!). Trees allow | you to travel up (parent node), down (child node), and | left/right (sibling nodes). Graphs you're limited to just | traveling to adjacent nodes. You could try to algorithmically | _deduce_ parent/child relationships though (that would be an | interesting thing to try! I'm sure algorithms exist that do | this). Ways of browsing graphs is definitely an interesting | problem space! Open Library does also have tags (called | "Subjects"), so finding a way to make them more user-browsing | friendly would be great :) | 1vuio0pswjnm7 wrote: | Does openlibrary.org support Z39.50 access? | | The way the openlibrary.org site is constructed seems better than | the others that came before, e.g., WorldCat. Every page is not | just HTML but JSON, too. Omit the slug and add .json after the | ID. | | https://news.ycombinator.com/item?id=25498127 | | This is without even considering the availability of bulk data | dumps. A+ | mekarpeles wrote: | Hi thanks kindly for the question, we don't currently have | Z39.50 or OAI-PMH access, however we do surface content via | OPDS: | | https://ianews.wordpress.com/2011/03/03/open-library-opds @ | https://bookserver.archive.org. ___________________________________________________________________ (page generated 2020-12-21 23:00 UTC)