[HN Gopher] Vizy, an AI Camera for the Pi
___________________________________________________________________
Vizy, an AI Camera for the Pi
Author : kordlessagain
Score : 135 points
Date : 2021-04-23 16:18 UTC (6 hours ago)
(HTM) web link (vizycam.com)
(TXT) w3m dump (vizycam.com)
| VectorLock wrote:
| Is this software available free or open-source? I'd like to build
| one of these from parts I have rather than pay $300 for this.
| fudged71 wrote:
| What I would really love is a camera looking out each side of my
| house and one upwards, looking at both ground and sky. Train it
| over the span of a year. And then notify me whenever something
| novel happens.
|
| Beautiful sunset? Let me know. Strange car parked in front of my
| house? Let me know. Neighbours house on fire. Backyard intruder.
| Flooding. Etc. Anything sufficiently new that the camera hasn't
| seen before.
|
| Is there anything for that?
| ilaksh wrote:
| The problem is that something as ambiguous as you described
| requires human-level AI.
|
| But if you could accept portions of it, you could build a
| detector for unusual vehicles (would yield a lot of false
| alarms). And a detector for beautiful sunsets. A system that
| would recognize individuals by gait and be trained by you for
| specific authorized persons. A detector for water on the
| ground.
|
| It's possible to just detect any movement or significant change
| in the scene, but that would yield quite a few events that were
| actually not interesting. Like birds landing.
| Tenoke wrote:
| There's no reason for outlier detection to require human-
| level AI. It's probably doable with prediction on different
| semantic levels, and a lot of calibration.
| ep_jhu wrote:
| Scale down your scope and it might be doable.
|
| One of my pandemic projects was a Pi4 with HQ camera to
| detect/ID helicopters flying by my building, and also create
| sunrise/sunset videos and post them to twitter
| (https://twitter.com/dcskycam).
|
| I set up the camera and used an OOB object detection model
| which works well enough. Also trained custom classifiers for
| helicopters after I had enough training data (work in progress
| for some aircraft types).
|
| Also consider that some of the things you mention, a camera is
| not the best sensor for the task.
| llamataboot wrote:
| I backed this back in the fall for a winter ship date, so I'd
| take the June ship date with a grain of salt.
|
| Not quite as long as my Mycroft kickstarter which shipped a full
| 2.5 years after expected shipping (but they DID ship so kudos to
| them) but yeah, hardware etc seems to always hit way more snags
| then expected
| ajsharp wrote:
| Have been desperately wanting something like this so I can build
| an AI to detect when people don't pick up their dog shit in front
| of my gate. I am saved.
| scottlamb wrote:
| You probably want to mount a weather-resistant camera outside.
| You could buy an eg Reolink security camera for this fairly
| cheaply. [1] Then you can stream the video to a Raspberry Pi 4
| + Coral USB accelerator, an nVidia Jetson nano, or the like and
| do analysis there.
|
| [Edit: oh, I missed that the Vizy has an outdoor enclosure
| available. Still, it's extra $60 and is huge/ugly. The off-the-
| shelf IP camera + separate computer for analysis should be
| cheaper and IMHO better.]
|
| I'm working on a Free Software security camera NVR system. [2]
| I have a pretty solid core recording engine now and am just
| thinking about what the API for on-NVR analytics plugins should
| look like. I'm imagining a Python API where you write some
| coroutine that can iterate through decoded video frames (either
| live or backlogged) and make calls to your favorite ML
| frameworks; add events, object detection tracks, and other
| metadata to the database; instruct that MQTT messages be sent;
| etc. If you're interested in using this kind of thing, I'd love
| to talk more.
|
| [1] I used to recommend Dahua or Hikvision, but it seems
| they're actively supporting the Uyghur genocide via custom
| software, eg <https://www.latimes.com/business/technology/story
| /2021-02-09...>. I won't be buying any more cameras from them;
| I'm sure my boycott will devastate their business and cause
| them to reconsider their position immediately. As far as I
| know, Reolink is uninvolved, despite also being a Chinese
| company.
|
| [2] https://github.com/scottlamb/moonfire-nvr
| spicybright wrote:
| If you're serious, please do a write up. I'm sure TONS of
| people would appreciate a project like this.
| ajsharp wrote:
| Oh I'm dead serious. I want it to play an audio file when it
| detects a dog shit: "Thank you for kindly picking up your dog
| shit."
| TheSkyHasEyes wrote:
| Seconded. If they built and blogged about this it would go
| viral I would think. :)
| jjeaff wrote:
| Just get a fake camera with a light and put it in an obvious
| place so everyone that walks by notices they are being filmed.
| [deleted]
| ilaksh wrote:
| You can get the latest most powerful Raspberry Pi and connect
| any decent compatible camera, find a telescope adapter, and run
| something like Tiny-YOLO. That will save you around $200.
| endisneigh wrote:
| I'm not sure if you're serious but this is pretty overkill for
| that.
| azinman2 wrote:
| They said they use the standard Sony camera but did driver
| changes to support 300fps... I'm very surprised that the rpi can
| handle 300 frames per second! Maybe very low resolution? But
| still that's quite impressive for the SoC!
| ilaksh wrote:
| It really depends on what you are trying to do 300 times per
| second.
|
| EDIT: Actually I just saw an article that I believe says 244
| fps for Tiny YOLO on R Pi.
| kejaed wrote:
| https://hackaday.com/2019/08/10/660-fps-raspberry-pi-video-c...
| helsinki wrote:
| If you throw in a classifier for detecting dog poop, and ideally,
| urine, I will buy five of them, place them around my home, and
| ensure the floors are clean before sending an API call to start
| my robotic vacuum. Thank you.
|
| Edit: there is a market!
| https://news.ycombinator.com/reply?id=26916974&goto=item%3Fi...
| amelius wrote:
| Just hack your robovac to avoid the poop.
| msgilligan wrote:
| There's also the Poopinator:
| https://www.cloudbrigade.com/correcting-bad-behavior-with-ai...
| outworlder wrote:
| There are some robo vacuums with cameras that will avoid poop
| helsinki wrote:
| Speaking of, does anyone know of a good dog poop image
| classifier?
|
| Edit: Found the treasure! https://www.kaggle.com/mikian/dog-
| poop
| darepublic wrote:
| a few years back I wanted to do something like this with an
| automated flow where if an in car camera detects parking
| enforcement it will call the city parking api and pay for the
| next n minutes.
| canada_dry wrote:
| I particularly like their "smart power". RPIs not having a
| standard on/off button is just unnecessarily annoying.
| nshm wrote:
| Well, you can do some basic things with this but honestly RPi4 is
| pretty much underpowered CPU for any serious AI. You can run some
| optimized networks probably even 200 fps like TinyYOLO linked
| below but it will always be a tradeoff between accuracy and
| hardware capabilities.
|
| If you want AI you'd better consider Jetson or figure out some
| other DNN accelerator.
| ilaksh wrote:
| Jetson Nano does not seem a lot better than Rasp Pi to me.
| Nvidia Xavier NX is a different story.
| tjoff wrote:
| For many applications 1 fps is plenty though
| dchichkov wrote:
| There are a few other, less expensive kits: AIY Vision Kit from
| Google, with Pi Zero ($50). Jetson Nano + IMX219 ($90).
| intrasight wrote:
| And Nano has an upgrade path - to Xavier
|
| https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
| amelius wrote:
| 500 frames per second? Wow, that's a lot.
|
| How fast is the image classifier, and what model does it use?
| guymcgwire wrote:
| Love this. Moving to CM4 will make the form factor even better.
| If you're interested, here's an AI camera paired with a steerable
| hyperdirectional speaker that uses the Raspberry Pi and Google
| Coral: https://www.toutaudio.com/
| neartheplain wrote:
| "The technology to deliver targeted audio messages in stores
| didn't exist. So we invented it."
|
| Bastards. /s
| phreeza wrote:
| Why is it seemingly impossible to buy DSLR grade image sensors
| for diy projects at a reasonable price?
| bvvvv wrote:
| I have run into this issue as well. I just want a webcam with
| decent resolution.
| bvvvv wrote:
| Why can I buy a 30mp trail camera with motion sensor and wifi
| for $70 but I cant buy a 30mp camera that connects to my
| computer over usb for that cheap.
|
| https://www.amazon.com/Victure-Activated-Waterproof-Detectio...
| hnnnnnnng wrote:
| This has 8 mp
| https://www.amazon.com/dp/B08F3CJ5HF/ref=emc_b_5_mob_t
| Aea wrote:
| How does this compare to the OAK-1 and OAK-D from opencv.ai?
| codezero wrote:
| Not sure, but at a glance it seems the OAK models are for
| developers to build up their entire use case from scratch, the
| Vizy _I think_ is pretrained with a lot of object recognition
| and has some tooling to take action based on that stuff built-
| in. So more of a purpose built device with some existing
| tooling vs an open-ended developer device that you bake the
| full product out yourself.
___________________________________________________________________
(page generated 2021-04-23 23:00 UTC)