[HN Gopher] Show HN: GraphJSON - Easily log and analyze events u...
___________________________________________________________________
Show HN: GraphJSON - Easily log and analyze events using ClickHouse
Author : flurly
Score : 95 points
Date : 2022-08-17 16:04 UTC (6 hours ago)
(HTM) web link (www.graphjson.com)
(TXT) w3m dump (www.graphjson.com)
| Ataraxy wrote:
| I'd extend the API to allow for querying via JSON similar to keen
| rather than merely focusing on visualizations.
|
| Honestly as a dev all I want is a simple/fast/cheap keen
| alternative that I can dump events into and do ad-hoc analytical
| queries with programmatically.
| flurly wrote:
| It's not documented, but you can actually already do this. Feel
| free to shoot me an email at hi@graphjson.com and I'll get you
| set up.
| encoderer wrote:
| We use GraphJson for some internal analytical data at Cronitor
| and couldn't be happier. JR is responsive and the service does
| exactly as advertised.
| flurly wrote:
| Thank you Shane!!
| radiojasper wrote:
| That's an excellent explainer video. Good luck!
| flurly wrote:
| Thank you!!
| hk__2 wrote:
| Small note: there's a typo in the FAQ under "What am I paying
| for?": "entrepeneur".
|
| I'm not sure I understand the pricing: the FAQ talks about a
| "free tier" but the Pricing page shows only a $12/mo tier.
| flurly wrote:
| Pushing typo fix now. Thanks!
|
| The pricing page could definitely use some work. To clarify -
| there is a free forever tier of 5k events. If you go over, then
| the only available tier is the $12/mo per million events tier.
| seanlaff wrote:
| Is there more behind the scenes than just the `timestamp | json`
| table? From what I understand, any query in clickhouse against
| that involving a filter would require a full table scan
| flurly wrote:
| Yes behind the scenes we have a few additional columns like
| uid, collection and insert_timestamp to optimize queries and
| support migrations. I just use timestamp/json columns as
| examples to illustrate the core idea behind GraphJSON.
| mcintyre1994 wrote:
| I used GraphJSON to build myself a slightly ridiculous dashboard
| (callum.run) and it's been great to build on. And JR has been
| super helpful with getting all my wacky ideas working :)
| Everything on that site is a GraphJSON visualisation, some
| displaying the logged data directly and some displaying results
| of SQL queries over it. Being able to combine them is really
| nice, the SQL gives a lot of power. It was a cool excuse to learn
| some ClickHouse functions too, which are awesome!
|
| I also have a GraphJSON importer in pyground
| (pyground.vercel.app), which lets you load a GraphJSON collection
| into Python in-browser and use eg. pandas/matplotlib to poke at
| it too.
| flurly wrote:
| Thank you Callum!
| futhey wrote:
| GraphJSON has some nice APIs for embedding charts inside your own
| apps - Much like how Keen.io operated back in the day (but
| without the scammy business practices).
|
| So, if you're a developer and you want a Mixpanel-style API to
| send events, and then a secure way to query them for individual
| customer accounts, and embed dashboards in your SPA, you can do
| all this, with some nice data visualization / chart building
| tools inside GraphJSON.
| flurly wrote:
| Thank you for the kind words James!!
| flurly wrote:
| Hi HN,
|
| My name is JR and I had a need for a simple analytics solution
| that allowed me to store (timestamp, json) logs and run SQL over
| them.
|
| It was hard to find the right solution. Solutions like Mixpanel
| and Amplitude optimized for particular report types. Whereas
| solutions like Snowflake, BigQuery, etc. required a lot of setup.
|
| I built GraphJSON to fit in the middle. I strived for the ease of
| use of tools like Mixpanel and Amplitude, but wanted to ensure
| affordances were built to support use cases that big data
| warehouses enable.
|
| Under the hood, GraphJSON is powered by ClickHouse. This enables
| really efficient disk compression and fast queries. In many ways,
| you can think of GraphJSON as an easy way to explore ClickHouse
| without having to run and maintain your own clusters.
|
| I'd love for you to give it a try. You can generally start
| logging your data in under a minute. From there, you can either
| use the UI tooling to create graphs in a no-code way. Or if
| you're more advanced, you can use the SQL editor to do any query
| you can think of!
| shinzui wrote:
| GraphJSON looks nice. Do you mind sharing the clickhouse
| infrastructure that's powering it?
| flurly wrote:
| I'm not sure what you mean. ClickHouse is an open source
| project. You can check it out here
| https://github.com/ClickHouse/ClickHouse
| linuxdude314 wrote:
| I believe they are referring to how you architected your
| ClickHouse deployment(s).
|
| Are you cloud based? Using container orchestration?
|
| Is it one cluster per customer? Multi-tenant? Can I use all
| standard available ClickHouse integrations?
|
| How do you manage scaling?
|
| Its not the easiest system to manage at scale, so getting
| some insight here would be a good way to help your
| customers see some competency here!
| flurly wrote:
| Ah I see. Let me answer your questions one by one.
|
| > Are you cloud based? Using container orchestration?
|
| Yes it's all in the cloud. The infrastructure is spun up
| using terraform and automated using ansible.
|
| > Is it one cluster per customer? Multi-tenant?
|
| Multi tenant with rate limits to ensure one customer
| doesn't take down the entire cluster.
|
| > Can I use all standard available ClickHouse
| integrations?
|
| Most of them are enabled by default - for instance window
| functions are available. If there is one that isn't
| available, feel free to email me and I'll most likely
| enable it.
|
| > How do you manage scaling?
|
| Unfortunately ClickHouse doesn't have a notion of
| consistent hashing, so currently we scale by simply
| adding more nodes and reindexing the whole table. That
| being said, Clickhouse is incredibly space efficient, so
| we haven't had to do this very often.
| julienfr112 wrote:
| Infra meaning hardware ?
| turtlebits wrote:
| Looks great - recently there have been many logging tools built
| around Clickhouse and JSON, what differentiates you from the
| existing services?
| flurly wrote:
| Thank you! I'm actually not familiar with these recently
| built services. Can you link a few?
| mritchie712 wrote:
| I know of posthog and logtail:
| https://twitter.com/thisritchie/status/1557070387275505664
___________________________________________________________________
(page generated 2022-08-17 23:01 UTC)