I’ve had pretty good luck running llamafile on my laptop. The speeds aren’t super fast, and I can only use the models that are Mistral 7B and smaller, but the results are good enough for casual use and general R and Python code.

Edit: my laptop doesn’t have a dedicated GPU, and I don’t think llamafile has support for Intel GPUs yet. CPU inference is still pretty quick.

So it takes you 15 minutes to put water in tank, put grounds and filter into the coffee pot, and brew it? And you can’t do anything else productive with your time while the coffee is brewing like take a shower, login to work a few minutes early and read and answer emails, brush your teeth, do some dishes, take out the trash, walk your dog, or anything?

And your work doesn’t allow you to get up out of your chair for the 30 seconds it would take you to walk from your computer to coffee pot and fill your cup and walk back? Or even better, bring the entire carafe back to your desk with you? Are you working for the FSB and they have surveillance cameras in your house or something?

It really sounds like you’re trying your absolute hardest to turn making coffee into such an onerous chore that it negates all the other benefits of not having to schlep to an office.

My personal theory is that a lot of advocacy for working in-person goes away when you remove:

1. People that financially benefit from office culture (office land lords, restaurants near office buildings, janitorial services, etc.)
2. Social vampires that view the office as the best place to gossip and share their boring personal lives with a captive audience
3. Managers and executives with poor leadership skills and low self esteem

It takes you more than 10 minutes to make a cup of shitty office coffee at home?

Your job is so strict that you can’t afford to step away from your computer for the 10 minutes it takes you to start a coffee pot, go back to work, and then step away again to get the coffee when it’s ready?