[HN Gopher] Cloud AI Platform Pipelines
___________________________________________________________________
Cloud AI Platform Pipelines
Author : jamesblonde
Score : 79 points
Date : 2020-03-12 18:31 UTC (4 hours ago)
(HTM) web link (cloud.google.com)
(TXT) w3m dump (cloud.google.com)
| talolard wrote:
| My first thought was how long till it's discontinued?
| KarlKemp wrote:
| That's more of a reflex than a thought, the latter usually
| involving at least traces of creativity.
| mav3rick wrote:
| Longer than the time it will take for the anti Google HN bubble
| to burst.
| dna_polymerase wrote:
| I'm sorry but GP is exactly right. Google has a horrible
| track record for their products. They can't even profit from
| vendor-lockin, as they kill off all the products sooner or
| later leaving a lot of angry customers.
| snug wrote:
| Name the GCP products that have been killed off?
| rllin wrote:
| google deployment manager. it has incredibly subpar
| support for other GCP services. all support interactions
| resort to them suggesting migration to Terraform. we do
| use it in production, but not without great headache.
|
| this isn't an explicit kill-off, but certainly
| purposefully offering bad support
| plexicle wrote:
| The pre-built pipeline components look interesting.
|
| I wish Cloud AI offered an API for the kind of results that I get
| when I use Google Lens. None of the ML offerings seem to come
| even close with labels.
| sologuardsman2 wrote:
| Their Cloud Vision API [1] might be what you're looking for.
|
| [1] https://cloud.google.com/vision
| plexicle wrote:
| Yeah that's the one I was talking about. It gives some labels
| about stuff in the image and it works well. But Google Lens
| is on a different level -- you can send it a picture of a
| breed or a snake and it will return species and subspecies.
| Can't find anything like that in the GCP offering.
| notlukesky wrote:
| Also take a look at:
|
| https://chooch.ai/
| minimaxir wrote:
| This product appears to have a lot of overlap with Cloud Composer
| (https://cloud.google.com/composer) except with more of an AI
| focus.
|
| Does that mean Cloud Composer might get depreciated?
| fooker wrote:
| Of course, this is Google. Everything overlaps with something
| can get shut down after a promo cycle.
| danols wrote:
| This argument is getting old for B2B products. Would you mind
| sharing a list of Google Cloud Products or even just Business
| to Business related products that have been shut down?
| tedivm wrote:
| App Maker, Google Cloud Print, Google Hangouts, Hire by
| Google, Fabric, Google Station, Google Correlate, Google
| Translator Toolkit, Google Fusion Tables, G Suite Training,
| Hangouts on Air, Google Cloud Messaging, Inbox by Google,
| Google URL Shortener, Google Realtime API, Google Site
| Search, Google Spaces, Picasa, Google Checkout.
|
| I got bored and stopped before finishing 2012, but you can
| go back and find more.
| 9nGQluzmnq3M wrote:
| There are literally zero GCP products in that list.
| (Despite the unfortunate naming, both Cloud Print and
| Messaging predate GCP and have nothing to do with it.)
| dkobran wrote:
| GCP has been around for a fraction of the time of Google
| as a company. It is perfectly valid to have at least some
| concern here as Google as a company has a long track
| record of shutting down products. Conversely, it is
| tenuous at best to use the argument that since GCP has
| never shutdown a product that they won't given how many
| of their products were launched very recently.
| danols wrote:
| App Maker is probably the worse on that
| killedbygoogle.com copy & paste list. Rest are B2B
| really?, the product evolved and got re-
| branded/consolidated or meh, was it really widely used
| anyway? Not a single one is a Google Cloud product.
|
| I am no Google fanboy and get frustrated by a lot of
| things they do. But I think the Google kills everything
| argument for B2B products is getting tiresome. Especially
| in a Google Cloud Platform context.
|
| Their actions on the Google Maps API absurd price hike
| and the recent GKE pricing structure change debacle is a
| whole other story and worth a lot of criticism.
| tedivm wrote:
| I absolutely consider the rest of the best to be B2B.
| Some of them are also used by consumers (in the same way
| that many products are both B2B and B2C), but all of
| those products have business use cases. Whether it was
| "widely used anyways" is a different argument and a bit
| of a shift in the goalposts.
| joshuamorton wrote:
| Were any of them paid B2B products that required any
| effort by the "client" to migrate? Because if its not
| paid, its not really a B2B product.
| ecnahc515 wrote:
| They've done the bait and switch with plenty of B2B
| products. Eg Google Maps API and GKE.
| danols wrote:
| Has nothing to do with killing B2B products. But I share
| your frustration and distrust in them for those two
| changes.
|
| With the Google Maps API price change they demonstrated
| that they are very capable & willing of abusing their
| market position with shocking price hikes and with the
| GKE structural price change that they are no longer
| interested in the trust & business from small & medium
| size companies and unless you are enterprise size you can
| expect unpleasant price changes going forward.
| boulos wrote:
| Disclosure: I work on Google Cloud.
|
| Different things! Composer (based on Apache Airflow, which we
| contribute to) is a general purpose workflow system. Cloud AI
| Platform Pipelines is really focused on ML pipelines,
| specifically, like Kubeflow (the related OSS project that we
| contribute to) is meant to be.
|
| Instead, I would argue that Kubeflow has lots of overlap with
| Airflow. But I don't think either will be cancelled :).
| [deleted]
| thefounder wrote:
| Just make sure you build some abstractions and have a backup
| plan. Don't get locked-in their API. It may/will ruin your
| business.
| siganakis wrote:
| Cloud AI Platform Pipelines appear to use Kubeflow Pipelines on
| the backend, which is open source [1] and runs on Kubernetes.
| The Kubeflow team has invested a lot of time on making it
| simple to deploy across a variety of public clouds [2], [3].
|
| If Google were to kill it, you could easily run it on any other
| hosted Kubernetes service.
|
| I haven't used Cloud AI Platform Pipelines, but have spent a
| lot of time working with Kubeflow Pipelines and its pretty
| great!
|
| [1] https://github.com/kubeflow/pipelines
|
| [2] https://www.kubeflow.org/docs/aws/ (Deploy to AWS)
|
| [3] https://www.kubeflow.org/docs/azure/ (Deploy to Azure)
| jamesblonde wrote:
| I have a couple of quick takes on this:
|
| * Remember kubeflow - the open-source ML platform? Well, on GCP,
| it doesn't look so open-source anymore.
|
| * It looks like TensorFlow Extended has been subsumed (killed
| off?) by this new managed platform. No Beam support - to be
| replaced by tf.data service?
| https://github.com/aaudiber/community/blob/rfc-data-service/...
| doomslice wrote:
| This looks like it's basically just an installer for Kubeflow
| -- this is not "managed" at all.
|
| And where did you get that TFX has been replaced by this? You
| can run Kubeflow pipelines (including those created by TFX) on
| this.
| jamesblonde wrote:
| "Kubeflow pipelines SDX and TFX SDK ... Over time, these two
| SDK experiences will merge" from the article.
| doomslice wrote:
| That's just the SDK that they're saying is merging (with
| TFX being the one that "wins"). If you've used them you'll
| know they have huge overlap but TFX abstracts a ton of what
| it's actually doing.
| jamesblonde wrote:
| TFX is just a SDK (with a few libraries - like data
| validation, model analysis, statistics). So, i don't know
| about saying it wins? The battle of ML pipeline
| ecosystems is the engine - not so much the API. It had
| been Beam vs Spark. Now, Google are changing tack and
| saying it is TensorFlow on Kubernetes with distributed
| processing vs Spark-based ML pipelines (that may use
| PyTorch/Tf for training).
| nancycut10 wrote:
| https://www.hackerslist.co/
___________________________________________________________________
(page generated 2020-03-12 23:00 UTC)