Bring back inertial navigation
Going deep on Etak and pre-GPS navigation tech got me thinking about what an inertial navigation approach might look like today. Sensors have only gotten more sophisticated and having to map-match yourself onto the route really doesnβt sound like that big of an inconvenience in exchange for tossing all the surveillance potential of GPS and tower triangulation-based geolocation tech. This is the only technical idea that I actually think could be cool and useful.
this idea from @lifewinning is so cool, i had not heard of inertial navigation https://placing.technology/i-was-in-a-bad-mood-and-i-wrote-down-my-worst-ideas-for-fixing-geo#bring-back-inertial-navigation https://en.wikipedia.org/wiki/Etak
09.10.2025 23:05 β π 0 π 3 π¬ 2 π 0
I wrote an exporter from my artificial pancreas loop system to the database. I can monitor glucose readings, automated insulin doses, etc., along with summary stats. I use tailscale to send data from my phone to the server, and can view from any machine connected to the VPN (like my laptop). #t1d
07.10.2025 23:08 β π 2 π 0 π¬ 0 π 0
These formats tend to trade core metrics for a long tail of features. I'm not totally convinced WASM is worth it here for most data, but could be useful for large datasets where data-to-header ratio is favorable & future accessibility is paramount (ie: census data or climate data).
02.10.2025 17:16 β π 1 π 0 π¬ 0 π 0
"F3: The Open-Source Data File Format for the Future"
db.cs.cmu.edu/papers/2025/...
A new contender to parquet. The most unusual aspect of the format is that it can embed WASM decoders directly in metadata, aiding portability and future-proofing. WASM is optional - perf looks OK, but size is meh.
02.10.2025 17:10 β π 3 π 1 π¬ 1 π 0
Screenshot of database dashboard with network debugger open showing 7.41KB per request
Database binary format sketch with bytes per component
I built out a binary format for the database, along with gzip/zstd compression (using gzip for now because safari is slow to adopt). A fully loaded channel is now 7.41KB per request. Can probably trim down slightly more with zstd dictionary training, but it's already very compact before compression.
17.09.2025 19:58 β π 2 π 0 π¬ 1 π 0
Vanillajs is a thing, and it works great for me. Installing half the internet is a project-by-project problem and I expect we'll see the same supply chain attacks occur in any ecosystem with similar package governance, once they get big enough and old enough for widespread bitrot, ie: rust/cargo.
17.09.2025 19:23 β π 2 π 0 π¬ 0 π 0
Added t-digest to the db, which allow percentiles to be estimated with a fixed memory footprint per channel. This is useful for key stats like medians, but also allows me to generate approximate CDF/PDF plots for understanding value distributions. Aiming for ~4KB total footprint per channel sketch.
13.09.2025 06:43 β π 1 π 0 π¬ 1 π 0
I also use uplot, which has an edge in practical performance, but with less features and documentation. I find myself struggling with overlapping labels and value text formatting using either lib. While uplot is faster, the API is still memory heavy (array-of-structs data representation).
08.09.2025 07:40 β π 0 π 0 π¬ 0 π 0
I've used observable plot for a few projects now, and can basically endorse it with a few caveats. It provides excellent charts out of the box, with minimal configuration, free of chartjunk/widgetjunk common in python viz world. It's surprisingly fast, but could be faster w/ a simpler feature set.
08.09.2025 07:25 β π 0 π 0 π¬ 1 π 0
First pass at a batch POST endpoint; benchmarks for single batch, single channel, best of 5 samples each:
- 1 week @ 1hz: 12ms
- 1 month @ 1hz: 27ms
- 1 year @ 1hz: 221ms
06.09.2025 01:50 β π 1 π 0 π¬ 1 π 0
The implementation is similar in timeseries features/function to Windows Task Manager, which is 5.6MB on Windows 11, vs 37KB (uncompressed) for this application - 2x smaller than the OG Task Manager for Windows NT 4.0 in 1996!
Now I'm adding batch endpoints for high throughput / high cardinality.
05.09.2025 19:48 β π 1 π 0 π¬ 1 π 0
Added a search bar and a number of demo feeds I'm using for testing the database. Here's me searching for ISS telemetry, then checking a channel that tracks the volume setting on my macbook, which updates in real-time.
05.09.2025 19:23 β π 2 π 0 π¬ 1 π 0
I made a video showing all aircraft within 100 miles of the EC president's aircraft during its flight to Plovdiv. One other aircraft exhibited symptoms of GPS interference at around the same time.
04.09.2025 20:42 β π 21 π 6 π¬ 2 π 1
Put it on the pile next to "I need to pay for a fresh prescription for insulin every few months for the last 30 years" I guess.
30.08.2025 06:14 β π 5 π 0 π¬ 0 π 0
Beautiful symbology on these! Also, TIL SF was full of horse race tracks.
22.08.2025 05:29 β π 1 π 0 π¬ 0 π 0
I have a docker-compose I use everywhere for spinning up and orchestrating prometheus and grafana instances. Those tools feel like magic for understanding systems, however, docker + go server + grafana server is a lot of variable overhead. Hoping this will be a more simple & predictable golden path.
20.08.2025 00:00 β π 2 π 0 π¬ 1 π 0
"Hello World!" from a new (very WIP) lightweight embedded database focused on online real-time statistics. The standalone executable is currently *9.94KB* compressed.
19.08.2025 23:53 β π 8 π 0 π¬ 1 π 0
SQLite | Node.js v24.6.0 Documentation
endorse
19.08.2025 18:25 β π 115 π 5 π¬ 11 π 0
Cubemon - Real-Time openGL rotating .png images from RRDTool. Images generated by stats from monitored devices rotate in cubes. This example showing 26 devices at once - Hamish Marson 2008/4
I was exploring RRDtool, a round robin timeseries database / plotting system, and came across this beauty. It's been around a while, so the gallery has many interesting examples: oss.oetiker.ch/rrdtool/gall...
19.08.2025 04:21 β π 1 π 0 π¬ 0 π 0
Loading a directory on a github repo with a single 140 line file inside:
161 requests
duration: 6.17 s
Contemporaneous speedtest:
down: 917.8 Mbps download
up: 841.5 Mbps upload
ping: 2 ms
06.08.2025 05:27 β π 0 π 0 π¬ 0 π 0
edits:
- b&w basemap
- additive RGBA composite rendering
- each line has low opacity (<10%)
- hue scaled to some interesting value, like heading equal interval
*glow map magic*
30.07.2025 21:47 β π 3 π 0 π¬ 0 π 0
morgan herlocker
How I write fast web pages for displaying data:
morganherlocker.com/post/Fast-da...
23.07.2025 00:15 β π 1 π 0 π¬ 0 π 0
Initial download sizes:
foxnews (21.62 MB)
wapo: (10.96 MB)
reuters: (9.28 MB)
nytimes (9.16 MB)
apnews (6.81 MB)
usatoday (336 KB)
02.06.2025 06:16 β π 0 π 0 π¬ 0 π 0
This is a fair comparison to raise, but Java '96 had unforced errors IMHO:
1. insanely long start time
2. requires non-default OS dlls - if packaged together, exe's would have been huge (latest java download is 40MB compressed - maybe it was smaller back then?)
3. legendarily shitty installer
23.05.2025 21:07 β π 0 π 0 π¬ 1 π 0
Silly example, but:
What if instead of sending a `meme.gif` (20KB) or a URL to a gif (1KB) to be viewed in a browser (300MB),
...we sent a `meme.gif.exe` to be viewed in a self-contained standalone viewer (20KB gif + 80KB exe).
23.05.2025 20:47 β π 0 π 0 π¬ 1 π 0
The standalone executable GUI/graphics program I'm working on currently weighs 289KiB, with minimal effort to optimize it so far. I love the shareability of web apps (just copy+paste a URL), but maybe there's a tipping point favoring the shareability of tiny exe's at some point on the size spectrum.
23.05.2025 20:31 β π 1 π 0 π¬ 1 π 0
"Program Files (x86)" vs "Program Files" has major report_final_final2.xlsx energy.
29.04.2025 17:14 β π 0 π 0 π¬ 0 π 0
This is my read as well. The core principle is to avoid marks that don't convey intentional information, because they are distracting or actively misleading. Go wild with ink that does convey information. The last chapter even praises *maximizing* ink w/ high data density displays.
23.04.2025 22:16 β π 2 π 0 π¬ 0 π 0
I'm in the process of setting up a cross-platform cmake setup for a project, and getting Windows working is... interesting. Even the projects trying to be "unix-y" like Cygwin are still heavily GUI driven and full of jank. I guess most devs just accept Visual Studio and heavy GUIs as a necessity?
17.04.2025 22:00 β π 0 π 0 π¬ 0 π 0
It is 100% worth making this cultural shift, but its not a technical problem that gets solved with WASM. If every web dev started writing pages with C++/emscripten tomorrow, we'd be flooded in 300MB Qt pages before long.
20.03.2025 19:06 β π 0 π 0 π¬ 0 π 0
I'm the burnt out library staff member you were warned about. The many adventures of a tired type 1 diabetic [Tslim x2 & G7].
#WearAMask #Insulin4All #ADHD #Dyslexia
Chronic Yapper with bad grammar.
Iteration & expansion of our mediaforms.
Embodying ourselves amid the digital.
Singing life to the new bodies electric.
To properly become connected together we must devise better forms to commune with the machine & connect w ourselves.
#BetOnTheWeb.
I teach data journalism at the University of Maryland, run OpenElections. Fan of WBB & test cricket. Posting obscure things about campaign finance, Congress & elections.
https://github.com/dwillis
https://thescoop.org
Oakland, Maps, Bikes, etc. Also @migurski@mastodon.social and formerly @migurski on the birdsite.
I enjoy pain. That is why I code simulation engines.
My blog: http://brashandplucky.com
Managing Data Editor, NBC owned stations. Public records attorney, journalist, ice hockey player/coach. Former bylines: NY Times , Washington Post, Eye on Ohio, etc.
Hearts= likes OR bookmarks
Demographics | Geospatial | Data Science | Open Source
That spoon is bigger than it looks. And it isn't a fork (in the road)
Member of Apache Software Foundation, committer on many Apache projects, Fellow at HPE.
my life is derp and i do derp shit
Data visualization & machine learning, owner of https://kontekst.io and https://zlopamtilo.si
Writing The Pragmatic Engineer (@pragmaticengineer.com), the #1 technology newsletter on Substack. Author of The Software Engineer's Guidebook (engguidebook.com). Formerly at Uber, Skype, Skyscanner. More at pragmaticengineer.com
Associate Professor of CS @ University of Maryland. Proud Rust advocate! I β₯ science & compiled, statically-typed programming languages! Views are my own. Tech stack: https://github.com/rob-p/tech-stack.
Scientist. ED of Clay, #AIforEarth. Ex MSFT Planetary Computer, Chief Scientist Mapbox, Satellogic VP, World Bank, Rocket scientist postdoc, astrophysics PhD. π Copenhagen. Dad to Sela and Paz, with Emma.
Decarbonizing the grid with Camus Energy. CEO, founder, dog appreciator. Ex-Google. I know it gets dark, but there's always a light.
Director of Technology at @openaq.org
We are all we have. We are enough.
EM @ Netflix Security. Encinitas CA. Dogs, sports, gaming, home improvement, food. he/him
#rstats geospatial data analyst. GIS expert, of a sort. Sci-fi fan and would be writer. Black cat owner. Occasionally apocalyptical. Can't DM.
WORDS ARE QUICK AND WORDS ARE VAIN, THE SINGLE SURE AND FINAL ANSWER MUST BE PAIN. -Dan Simmons, Olympos
Independent journalist, SnapStream brand ambassador, and publisher of the Public Notice newsletter https://www.publicnotice.co/subscribe
Academic at the β of cities, technology, and climate adaptation. Reluctant polygon enthusiast. Sometimes I work on computational geometry and spatial data algorithms, which I promise almost never to discuss.