Bart Trzynadlowski

Great minds think alike!

Gripper teleoperation using optical detection of fiducial markers.

RoBart, my iPhone-based and LLM-powered autonomous robot, is now open source.

github.com/trzy/RoBart

Health care is a space I’m interested in so I put together this demo of RoBart performing contactless vital sign measurement and a cognitive assessment. Would love to chat with folks in the health care space. 👋👨‍⚕️👩‍⚕️

YouTube video by BartTrzynadlowski Using LLMs and ARKit for robot vision: How RoBart sees

How RoBart sees. How to use an LLM to identify specific points in an image and ARKit to create those points.

youtube.com/shorts/68Blq...

Detecting UMI gripper state visually with mounted iPhone.

I’m building stuff :)

Nevada. 🌕👽✨

Nevada. 🌕👽✨

Great tips!

I’ve been working on some other stuff and am trying to figure out how to do customer discovery for robotics applications (esp. healthcare and manufacturing), which is proving difficult 😅 I hope to finish my backlog of videos and will show it doing contactless measurement soon!

I have been thoroughly CAD-pilled. Having a 3D printer and knowing some basic CAD is a superpower I wish I had developed years ago.

Claude C++ performance is not bad but lacking. I haven’t seen many outright mistakes but it does often produce redundant code (like setting status bools it then never reads again) and does other weird stuff. Anyone experienced this?

I spent 8 months hacking in SF ending in July. It was pretty astonishing how right wing Gen Alpha and Z guys are — and for seemingly no other reason than to be edgy and rebellious. But *women* voting for him is absolutely mind boggling.

Got a FLIR sensor. This is pretty dope.

Ouch 😰

My Claude+iPhone powered robot, RoBart, succeeded at hide and seek. Started in the kitchen and eventually found me. #robots

YouTube video by laffer35 Road Blaster longplay (arcade game, 1985)

Generative AI game engines should make it possible to have a fully playable, free roaming version of Road Blaster. I wonder how it’ll work — conditioned on a map of the game world? youtu.be/ciMTAcqdh4o?...

Definitely a bummer but people will just continue doing what they’ve always done: host ROMs on illicit sites and torrents. The first emulators appeared within the lifespans of their target consoles, so it was pure piracy to begin with. 😉

Ewww. But sometimes you gotta do what you gotta do!

My robotics work is on hold until I finish MechWarrior 5: Clans.

Once missed a connection in Phoenix and got put up at a hotel near the airport. Decided to take a walk on the pristine sidewalk next to a 6 lane street, since I had nothing else to do — I was the only pedestrian. Some kid drove by in a pickup truck and yelled “faaaaaag!!!” #idiocracy

Someone from Mayo Clinic told me that the way they think about robots is in terms of the departments that don’t deal with patients directly: food services, environmental services, laundry, pharmacy, etc. Anything where a person is pushing a cart around. See: www.chausa.org/publications...

I saw a Moxi robot drive by at the convention but didn’t get to get a close look. It does something very different: logistics support, especially transporting medications around.

Health care is a strange space. There is big demand for companion type robots that can comfort patients or care facility residents, administer simple assessments, and otherwise perform interactions that would tie up staff (and which staff often lack the empathy to perform well anyway).

Are you intentionally sticking to DOS to recreate a period appropriate dev environment? I want to do some Genesis dev in the future but would likely go with gcc and binutils for the assembler. I did that for Sega Model 3 (and wow was it painful to build a gcc cross-compiler on Windows).

I’m learning at HLTH that even a $2k-5k mobility assistance robot is considered way too expensive (and was told people who use walkers won’t live long enough for it to be worthwhile anyway). Healthcare is probably not a use case I’ll pursue, I guess.

My feed here is full of anime drawings. Not sure why. Selecting “see less of this” has had no effect on the algo. Anyone else facing this? I assume it’s because I follow some game dev folks but they aren’t the ones posting it.

You’ll probably need a sandbox environment that is pretty airtight because it will be abused :)

At HLTH in Vegas and have been using my Apple Watch-based AI conversation capture system. I especially like that it catches what I order. Don’t worry — had a complete metabolic panel done. Flawless. Ice cream consumption will continue unabated!

Stir fried? Served warm or chilled?