Hacker News new | ask | show | jobs
by pugio 26 days ago
AI + hardware has really helped my wife and I get more sleep.

I had an esp32-box-3 lying around from a lapsed "voice agent" project from a year or two ago. Had a baby. Baby moved to another room, sleep trained. Baby either: 1. wakes up a few times a night, babbles for a bit, goes back to sleep OR 2. baby wakes up and fusses for N (=10) minutes, at which point parents need to go in and settle (that's the sleep training routine we use).

In either case, we do NOT want to wake up every time the baby does. Baby can go back to sleep easily, we adults have a harder time. A few rounds with Claude and the esp32 is now our new baby monitor. It tracks cry/fuss duration and publishes an audio stream (via a web UI or direct with, say, VLC). The audio only comes through AFTER N minutes of fussing have elapsed. It also posts notifications (to ntfy) after 30s and N minutes. My log says baby often wakes up 1-2 times a night and resettles almost immediately. We only wake up if the audio comes through, after N (10) minutes.

Also during the day it's really handy to be notified when baby has woken up from her nap. Let's us be out of the house, or in a distant room, and still keep track of what's going on.

It's fun to keep improving and adding features to this. Never would have had the time/energy to get this done without a coding agent. I ordered a set of 10 more of the esp32-box-3s to give them out to my friends (well, some are for other projects... so much potential).

(EDIT: Yes, I know this isn't AI designing hardware, but even writing code for embedded off the shelf stuff feels like a huge new potential.)

3 comments

This is one of the killer use cases of AI, build personalized stuff for your life, that no company does. It is kind of generalized „intelligent stuff“ that one can use. Like minecraft your life
This actually feels like something that could be a popular app on a baby monitor.
Baby monitors fundamentally need to be safe and allow parents peace of mind. Knowing they can constantly hear the baby and communicate verbally to soothe, as if you were in the room with them, allows this. It already means you only have to respond and/or get up to tend if they are still unsettled after a period of time. Monitors also have volume control so you can stay alert without being constantly disturbed.

The traditional baby monitor system had three states (ON and functional, ON and non-functional, OFF). It provides a constantly available and instantaneous test for "functional" - as long as you can hear sound from the other unit, it's almost guaranteed to currently be in a safe condition. Monitoring is constant, human-first, and all human. The system is relatively fail-safe.

Your design replaces this with a multi-state system and algorithms (adding ON in listening mode, ON in delay mode with output off, ON and partially-functional etc.). It removes any reliable method to prove an obviously "functional" state at any given time. Monitoring is non-constant (for the human), machine-first, and human as last resort (like corporate customer services). The system is not fail-safe despite being machine-first and at higher risk of error or malfunction due to complexity.

The risks include a few failed notifications or incorrect delay timing leading to early developmental trauma, such as fear of abandonment. It doesn't take much. We are still learning to deal with this human-human, before adding invisible unknowns.

If nothing else, what are babies likely to learn in a pre-verbal state where the days are spent sensing and observing their environment to develop the brain? It'll probably be how to game the baby monitor algorithm.

> Also during the day it's really handy to be notified when baby has woken up from her nap. Let's us be out of the house, or in a distant room, and still keep track of what's going on.

If you are going out of earshot of the baby by doing this, you are fully relying on the technology being functional. That would seem unnecessarily risky, and not nice for the baby (they can sense this stuff). The odds of a catastrophe are low in a singular environment, but still enough to worry. Almost inevitably it would end badly if this were scaled to a mass consumer product.

The idea is interesting from an engineering view, but from a human one it feels dystopian to insert a machine between parent and baby to this extent. It removes/replaces a layer of human-human connection. Where does engineering the natural human experience out of life end? Automated feeding? AI nannies and teachers? Then onto AI therapist?

My suggestion would be to do a lighter version of the features in a system which focuses on safety (always being able to monitor no matter what, for example on the ESP32, you could have the second core independent and direct-output the feed if the first core hangs or crashes). Feature-wise, rather than not alerting for 10 minutes, you could apply a DSP algorithm which reduces harsh frequencies for this period, whilst slowly increasing the output volume of the monitor.

I like the idea of alerts because it expands the base features without risk, and crucially makes the babies life better, as alerts could be sooner for important things that do need attention quickly. As an experiment, you could add an SD card and record snippets of cries which ended up in alerts, tag them with an ordered list of what you did to soothe or what was wrong, and see if AI can make anything of the data. Maybe certain cries can trigger alerts sooner, or cries over an extended period may indicate fever.

Thank you for engaging with this thoughtfully. You've highlighted the HUGE difference between "bespoke just for me/us" and "product that works for everyone". I've been struggling with this myself, since its value to my family is such that I immediately think "how can I share/sell this to everyone?"

In my case, I have a separate heartbeat check process (running on another machine) which ensures that the monitor is correctly working (no silent fails). I also wired up a SECOND esp32-box-3 as a receiver, and it will complain loudly if the transmitter one isn't sending (much like most normal baby monitors do). The monitor (web ui) has an option of directly listening to the raw non-gated audio, which I use every now and then to confirm what's going on. I also record the streams sometimes for algorithmic improvement.

My aim is not to replace human connection with machines, it's to allow the parents a bit more sanity so as to be better carers for our children. So far we've gained in sleep, piece of mind, and reduced stress. The last one is important - listening to your baby yell for 10 minutes, even if you know they're just annoyed because they don't want to sleep, can be really draining (especially for mom). The notifications allow us to keep tabs on things without the direct audio line to the limbic system.