To borrow another example, taken from the `dbreg` README: github.com/grantmcdermo...
Here I am running a fixed-effects regression on 180 million(!) row parquet dataset... and it completes **< 2 seconds**... on my laptop π€―
This is powered by @duckdb.org under the hood.
#rstats #econsky
25.08.2025 18:38 β π 85 π 23 π¬ 4 π 4
What it took to get tenure in the Batman Studies Department in the 1960s, and what it takes to get tenure in Batman Studies today...
12.07.2025 02:24 β π 789 π 125 π¬ 9 π 8
The shuttle bus
05.05.2025 11:27 β π 0 π 0 π¬ 0 π 0
I once wrote to a full professor in Econ for the code - "code was available on request". The professor asked me to code it myself after reading the paper. Lol.
01.05.2025 02:12 β π 2 π 0 π¬ 0 π 0
LLMs are probably trained on a lot of pirated data. This working paper provides interesting evidence.
www.nber.org/papers/w33598
24.03.2025 19:00 β π 123 π 20 π¬ 3 π 1
DuckDB for processing, Parquet for publishing. Simple and powerful!
www.robinlinacre.com/parquet_api/
17.03.2025 09:31 β π 24 π 3 π¬ 0 π 0
DuckDB got a local UI. Thanks to our friends at MotherDuck, you can now interact with your DuckDB database through an interactive notebook, running on localhost. Read the announcement blog post at duckdb.org/2025/03/12/d...
12.03.2025 13:18 β π 171 π 47 π¬ 9 π 12
Mutated DNA Restored to Normal in Gene Therapy Advance
The small study in patients with a rare disorder that causes liver and lung damage showed the potential for precisely targeted infusions.
Researchers have corrected a disease-causing gene mutation with a single infusion carrying a treatment that precisely targeted the errant gene. The condition affects 100,000 Americans. These genetic treatments were fantasies 30 years ago, but they are now here.
www.nytimes.com/2025/03/10/h...
11.03.2025 02:05 β π 41 π 9 π¬ 1 π 0
lol ... Good one!!
11.03.2025 02:13 β π 1 π 0 π¬ 0 π 0
Evidently AI - ML and LLM system design: 500 case studies
How do top companies apply AI? A database of 500 case studies from 100+ companies with practical ML use cases, LLM applications, and learnings from designing ML and LLM systems.
This is a pretty cool resource for applied ML: a list of "case studies" sourced from different companies describing problems they face and the methods they've tried to solve them.
Anyone know of something like this specific to geospatial/remote sensing data problems? #MLsky #CCAI #GISchat
08.03.2025 20:00 β π 51 π 9 π¬ 1 π 0
Another health breakthrough.
10.03.2025 10:00 β π 317 π 67 π¬ 13 π 4
Unbelievable news.
Pancreatic is one of the deadliest cancers.
New paper shows personalized mRNA vaccines can induce durable T cells that attack pancreatic cancer, with 75% of patients cancer free at three yearsβfar, far better than standard of care.
www.nature.com/articles/s41...
27.02.2025 17:03 β π 7295 π 1930 π¬ 140 π 317
An image of Aaron Swartz with the following text: "Meta illegally downloaded 80+ TB of books from LibGen, Anna's Archive, and Z-library to train their AI models. In 2010, Aaron Swartz downloaded only 70 GBs of articles from JSTOR (0.0875% of Meta). Faced $1 million in fine and 35 years in jail. Took his own life in 2013.
My heart ached when I was reminded that Aaron Swartz was prosecuted for trying to make academic knowledge more accessible to the public. Meta, meanwhile, is doing it for their own bottom line. I'm going to guess that no one at Meta will be looking at spending 35 years in jail for this.
11.02.2025 23:45 β π 2205 π 951 π¬ 22 π 20
A *2011* grant from NSERC Research Tools and Instruments, for 60000 CAD, to Geoff Hinton (@geoffreyhinton.bsky.social)
For "Large scale machine learning using GPUs"
Everything you're seeing now started from a pittance of cash given by the Canadian government for fundamental research
07.02.2025 17:22 β π 94 π 19 π¬ 1 π 1
Can't agree more. (BTW, republicans spending ~ $200 million on anti transgender ads might have had an effect on the narrative)
22.01.2025 12:39 β π 0 π 0 π¬ 0 π 0
From my conversations, most seem to have a fear that their kids might get affected and change their gender/sexual orientation.
22.01.2025 10:47 β π 2 π 0 π¬ 0 π 1
Change in Paris air quality between 2007 and 2023 using visuals
Air pollution has dropped significantly in #Paris in the last 15 years. Mayor @annehidalgo.bsky.socialβs leadership has traded car space for green space, safe bike space, kid space.. and traded pollution for people.
Good trade.
17.01.2025 00:13 β π 15359 π 3617 π¬ 170 π 375
Here are the first five sets of slides:
01 Introduction: psantanna.com/DiD/01_Intro...
02 Classical 2x2 setup: psantanna.com/DiD/02_two_b...
03 Clustering issues: psantanna.com/DiD/03_Clust...
04 Functional form: psantanna.com/DiD/04_Funct...
05 Covariates: psantanna.com/DiD/05_Covar...
30.12.2024 05:19 β π 737 π 181 π¬ 52 π 15
When he was in the Navy, Jimmy Carterβs submarine was once docked in Bermuda. Some British officers invited only the white crew members to a cocktail party or something like that, and Carter said that if the crewmen of color werenβt invited then nobody was going. This was in the 1950s.
29.12.2024 21:25 β π 5918 π 1076 π¬ 82 π 38
Jimmy Carter was the only US President to have lived in public housing.
He lived a life of service and consequence. May he rest in peace.
30.12.2024 00:41 β π 403 π 65 π¬ 2 π 5
Weβve lost a great man. The economic reforms led by Manmohan Singh lifted hundreds of millions out of poverty, and gave them livelihoods, dignityβ and hope. And by all accounts, he remained empathetic, humble, thoughtful, and gentle to the very end.
26.12.2024 19:12 β π 54 π 10 π¬ 0 π 0
That looks like George's pose in Seinfeld ;)
26.12.2024 00:30 β π 1 π 0 π¬ 0 π 0
This workshop was a game-changer !!
08.12.2024 20:09 β π 1 π 0 π¬ 0 π 0
I'm proud of MIT for eliminating tuition for people whose families make less than $200,000 per year.
Stanford already charges no tuition for families below $150,000.
The top universities in America are much more affordable than most people realize.
21.11.2024 02:16 β π 128 π 23 π¬ 4 π 4
Indian context - www.moneycontrol.com/technology/z...
21.11.2024 00:48 β π 0 π 0 π¬ 0 π 0
Professor of Statistics and Data Sciences UT Austin | Prev JHUBiostat | R Programming for Data Science | Simply Stats Blog | Not So Standard Deviations | The Effort Report
Building data science tools @posit.co, #rstats, parenthood β¨πβ¨
Google Chief Scientist, Gemini Lead. Opinions stated here are my own, not those of Google. Gemini, TensorFlow, MapReduce, Bigtable, Spanner, ML things, ...
he/him - writing statistical software at Posit, PBC (nΓ©e RStudio)π₯
simonpcouch.com, @simonpcouch elsewhere
Education reporter at Bloomberg News. Send tips to lknox18@bloomberg.net
Assistant Professor at BU CDS
EconCS | Theory of CS | MD+AI+DS4SG | MD4SG co-founder
Previously Columbia, UW, Oberlin. Views are mine alone.
www.kiragoldner.com
Bronx boy. Cubs fan. Dad, husband, writer, podcaster and cable news host.
The Sirensβ Call: How Attention Became the Worldβs Most Endangered Resource out now.
https://sirenscallbook.com/
Associate Professor at University of Nottingham, Research Affiliate of CEPR (IO), Northwestern PhD
https://marit.hinnosaar.net/
Marketing Professor at Yale
I study algorithms/learning/data applied to democracy/markets/society. Asst. professor at Cornell Tech. https://gargnikhil.com/. Helping building personalized Bluesky research feed: https://bsky.app/profile/paper-feed.bsky.social/feed/preprintdigest
Cornell University
https://sites.google.com/view/rakeshallu/home
Social science and other distractions. Old posts get deleted pretty quick.
https://kieranhealy.org /
https://theordinalsociety.com
Associate Professor of Marketing at University of Texas at San Antonio. Visiting Professor at University of Mannheim. Machine learning, data visualization, marketing-finance interface, and R and Python coding.
PhD student at MIT
I use computational and experimental methods to understand beliefs, particularly as they relate to issues like misinformation and climate change.
LLMs, AI, Psychology and Speaking - Seeking to infuse technology with empathy. That's why I founded www.neuroflash.com. An AI platform driving brand-aligned marketing, and helping people connect and understand each other's perspectives.
NYU Politics prof. Methods to inform policy. Governance, conflict, institutions. cyrussamii.com
Writer, storyteller. Nebula, Hugo, Ignyte finalist. Work in
@strangehorizons, @Slate, @LightspeedMag etc. http://shivramdas.net.
I live in NYC, love trying new foods, traveling, and will post mostly about politics and life. Liberal/progressive. Posts & reposts are my personal opinions.
Manhattan Community Board Six member.
Editor in Chief, MeidasNews. Former Fed & State Prosecutor, Marine, Attorney. Switched parties from R to D in 2020. MeidasPlus.com/subscribe