Local AI

Why use local AI? Not just to save money

Detect the source language. Keep the target I chose.

Automatic detection should save a repeated choice while leaving the translation direction in my hands.

The translation took seconds. Loading the model took longer.

Timing the stages separately showed where most of the wait was going.

I closed LM Studio. My monitor kept waking it up.

The tool checking whether LM Studio was running was also starting it.

Let the queue run. Let me move the urgent job.

Once several tools shared the local model, I wanted control over which job came next.

Finish one small task before buying the next piece of hardware

The laptop, enclosure and V100 came in stages. Trying the equipment I had helped me decide what to spend on next.

The transcript was finished. Five minutes of speech were missing.

Listening to the recording again showed that the blank stretches contained speech the software had failed to transcribe.