AI Bots and Robots.txt
Thereβs been a lot of discussion lately around AI crawlers and bots, which are used to train LLMs and/or fetch content on behalf of their users. In the past few weeks Iβve seen blog posts about the am...
New @httparchive.org analysis about sites adding AI Bots and Crawlers to their robots.txt files. While robots.txt doesn't "block" bots by itself, it's a clear demonstration of the preferences of site owners and the sentiment towards AI crawlers on today's web. paulcalvano.com/2025-08-21-a...
21.08.2025 12:35 β π 12 π 5 π¬ 1 π 0
[In-person] Meet for SPEED, Thu, Jul 24, 2025, 6:00 PM | Meetup
Join up for an opportunity to work together on optimizing our sites.
Have a site you'd like us to analyze? Add it here - [https://bit.ly/meet4speed-submit](https://bit.ly/
This Thursday at 6pm the NYC WebPerf Meetup is running another in person "Meet for Speed" session. We'll be taking requests from attendees for sites to do a web performance analysis on.
www.meetup.com/web-performa...
Have a site you'd like us to analyze? Add it here - bit.ly/meet4speed-s...
21.07.2025 20:04 β π 4 π 0 π¬ 0 π 0
[In-person] Meet for SPEED, Thu, Dec 19, 2024, 6:00 PM | Meetup
Join up for an opportunity to work together on optimizing our sites.
Have a site you'd like us to analyze? Add it here - [https://bit.ly/meet4speed-submit](https://bit.ly/
Tonight at 6pm the NYC WebPerf Meetup is running another in person "Meet for Speed" session. We'll be taking requests from attendees for sites to do a web performance analysis on. Fastly will be hosting us at their NYC office.
www.meetup.com/web-performa...
19.12.2024 16:00 β π 2 π 0 π¬ 0 π 1
The video of my talk from the Performance Now conference in Amsterdam was posted today. #perfnow
18.12.2024 01:18 β π 12 π 5 π¬ 1 π 0
Performance Mistakes, Fri, Dec 6, 2024, 4:30 PM | Meetup
December's meetup will feature Paul Calvano, on his return from the PerfNow conference in Amsterdam.
**Agenda**
* 4:30 pm: Arrive & networking
* 5:00 pm: Talk starts
* 5:
If you missed @paulcalvano.bsky.social at @perfnow.bsky.social, and happen to be in the Boston area next week, he'll be speaking at the Boston Web Performance December meetup.
Sign up on meetup: www.meetup.com/boston-web-p...
December 6th β 4:30pm β Akamai HQ in Cambridge.
#webperf #perfmatters
27.11.2024 02:00 β π 8 π 3 π¬ 0 π 0
If you want the output of the query I can send that so that you donβt have to run it!
19.11.2024 12:48 β π 0 π 0 π¬ 1 π 0
Here's the query for that. I added a few comments to help explain it as well. The query will output 5 examples for each third party as well. console.cloud.google.com/bigquery?sq=...
19.11.2024 12:33 β π 0 π 0 π¬ 1 π 0
Hey - thanks! Happy to share. I don't have them all neatly organized right now, but plan to write a few blog posts with all the details and queries. In the meantime, if there are any particular queries you are interested in let me know and I'll send them over!
19.11.2024 12:05 β π 0 π 0 π¬ 1 π 0
Just posted them - bsky.app/profile/paul...
19.11.2024 11:37 β π 1 π 0 π¬ 1 π 0
Can anyone think of other web performance mistakes that you suspect might be occuring on a lot of sites? We might be able to query that in the @httparchive.org too, and I'd be happy to help you get started if you are interested in exploring the dataset!
19.11.2024 11:37 β π 3 π 2 π¬ 1 π 0
Oh, and I made mistake in my talk about mistakes :). Apparently async image decoding isnβt that big of a deal for high priority images. So ignore #3 from my list, and check out @tunetheweb.com's blog post about that here - www.tunetheweb.com/blog/what-do...
19.11.2024 11:32 β π 5 π 1 π¬ 1 π 0
A few attendees told me they found some of these mistakes on their websites while we were still at the conference! So now they can be considered performance opportunities :)
19.11.2024 11:32 β π 1 π 0 π¬ 1 π 0
Performance Now '24- Performance Mistakes - Final.pdf
Performance Now '24- Performance Mistakes - Final.pdf - Download as a PDF or view online for free
Last week I gave a talk at the #PerfNow conference titled βPerformance Mistakesβ. I started off explaining a bit about Etsyβs blameless culture, and how itβs ok to make mistakes. Then I shared 17 common #webperf mistakes using @httparchive.org data, with examples.
www.slideshare.net/slideshow/pe...
19.11.2024 11:32 β π 64 π 23 π¬ 2 π 1
Hey! Thanks Marc. Iβll be posting them later today. Will let you know once they are up!
18.11.2024 17:21 β π 1 π 0 π¬ 1 π 0
Seriously. It's such a breath of fresh air!
18.11.2024 11:57 β π 2 π 0 π¬ 1 π 0
Great start to #perfnow this year with @tammyeverts.bsky.social and @csswizardry.com !
For those of you looking for the general web perf starter pack, here it is! Lots of new folks since last time I shared it
go.bsky.app/RVWSVqe
14.11.2024 09:52 β π 20 π 10 π¬ 4 π 1
Choosing Between gzip, Brotli and zStandard Compression
HTTP compression is a mechanism that allows a web server to deliver text based content using less bytes, and itβs been supported on the web for a very long time. In fact the first web browser to suppo...
I wrote a blog post that goes into detail on this: paulcalvano.com/2024-03-19-c...
TLDR: if you are serving any dynamically generated responses on the server, then gzip level 6 or brotli 5 are reasonable defaults. If you -only- serve static cacheable resources then turn it up all the way.
16.11.2024 20:46 β π 1 π 1 π¬ 1 π 0
Contribute
Passionate about a topic? Working on a new tool? Have a technique you want to teach? Research you've done? Tell the web performance community!
Send your articles to ssttoo@ymail.com. Please include:
...
Fellow #perfnow attendee, the PerfPlanet advent calendar is looking for articles for the 2024 edition. Please come talk to me if youβre considering an idea for a post but youβre not sure and you need a second opinion calendar.perfplanet.com/contribute/
14.11.2024 11:20 β π 9 π 11 π¬ 0 π 0
Took 2 mins at #PerfNow to talk about the RUM Community Group in W3C for anyone doing RUM. It's free and easy to join if you're interested! www.w3.org/community/ru...
14.11.2024 14:01 β π 25 π 17 π¬ 0 π 1
Such a great talk! Thank you so much for sharing. And it was great to meet you this week!
16.11.2024 20:20 β π 0 π 0 π¬ 1 π 0
Yesterday during my #perfnow talk, I mentioned the Web Performance Slack. If youβd like to join the Slack, use this link before Nov 25: join.slack.com/t/webperfβ¦
15.11.2024 08:39 β π 19 π 10 π¬ 1 π 0
That would be great!!
16.11.2024 20:02 β π 0 π 0 π¬ 1 π 0
Official Firefox account for people who build on the web. Learn about the things we're working on to grow and improve the web platform.
π©π»βπ» Coder, Writer, Educator | ex. Atlassian, Jira | Principal Engineer
π Developer Way Blog: https://www.developerway.com
π Advanced React book: https://www.advanced-react.com
π Web Performance Fundamentals book: https://www.getwebperf.com
Nx, Monorepo, Web Performance, Architecture, Angular, Reactive Programming
my life is derp and i do derp shit
Senior engineer frontend infrastructure at @KhanAcademy.org, accessibility advocate, cyclist, hiker, wife, mom π Bellingham, WA
Developer of sorts at @firefox.com. No thought goes unpublished. He/him.
Award-winning technical SEO consultant.
I help brands to compete on technical SEO, performance, and structured data.
https://www.jonoalderson.com
Web performance nerd, as seen on https://benmirkhah.com
He/Him - johnmu.com - Skeets my own. Google Search Advocate. Ask me about AEO/GEO. For #SEO: g.co/searchcentral . Cheese. Watches. Birds. Spreadsheets.
Do you like cheese? Say hi.
Ignore everything and speak in tongues.
Freelance dev sending Frontend news to 6k people over at webweekly.email. Sharing lots of tips'n'tricks on the way.
Google Dev Expert, Microsoft MVP and Playwright Ambassador
Fiber collage artist. Neuro Divergent Cat mom, dog mom, human mom. Collector and maker of many things.
I start things.
https://www.toddhgardner.com/
I am a generalist, currently employed as a front-leaning, ΒΎ-stack engineer at Fastly. I have a double major in political science and film theory, aka the Oliver Stone. I live in Denver. I can smell the onions and the mustard.
I'm a full stack engineer with a bias toward the front-end. Web performance optimization, accessibility, and all that jazz.
I stare at data about the Internet for Cloudflare.
https://radar.cloudflare.com/
https://mastodon.social/@dbelson
https://x.com/dbelson
https://internetdisruption.report/ (on hiatus)
Front-end developer for 30 years, advocate for web performance and a less bloated web. Design Systems, modern CSS, a11y, universal Web.
Trigger word: capitalism.
Seek first to understand.
Impatient optimist. Dad. Zetetic. Author. Speaker. Made Fiddler & SlickRun. My code runs in your browser. @ MSFT 18y+ on web and security. My words are my own.
he/him
https://ericlawrence.com/
https://textslashplain.com/
The W3C Web Performance Working Group, making the web faster and more reliable since 2010!!
Planning to post on upcoming meetings, their summaries and generally exciting work that happens in the web performance space