winget install Microsoft.FoundryLocal

Foundry Local is an on-device AI inference solution offering performance, privacy, customization, and cost advantages. It integrates seamlessly into your existing workflows and applications through an intuitive CLI, SDK, and REST API.

Foundry Local Architecture

foundry model run phi-3.5-mini

Foundry Local Service is running

Foundry model list

Run and stop the Foundry local Service.

More information on Microsoft Docs :

Microsoft Foundry Local documentation

https://learn.microsoft.com/en-us/azure/ai-foundry/foundry-local/reference/reference-cli