Category: AI
-
8 Tokens a Second
Eight tokens a second. That is the number that ended my experiment with running AI locally, and it is the reason my personal AI stack now sits on someone else’s GPUs.
I did not want that outcome. I run a homelab specifically because I like owning the thing that does the work. But after a few months of trying, the honest answer is that local inference did not earn its place, and the reasons are more interesting than “it was slow”.
-
My Perspective on Digital Marketing and AI
Your stack isn’t short of AI. It’s short of tools that talk to each other.
Count the tools your Digital Marketing team opened this week. An SEO tool. A social listening platform. Two analytics platforms, because someone (me) standardised twice. A CMS. A design tool. A DAM. A translation service. A social publishing tool. A survey platform nobody’s looked at since the last wave closed.