* feat: add amd gpu windows

* chore: remove unused code

* feat: get amd gpus

* fix: clean

* chore: cleanup

* fix: set activate

* fix: build windows

* feat: linux

* fix: add patches

* fix: map cuda gpus

* fix: build

* chore: docs

* fix: build

* chore: clean up

* fix: build

* fix: build

* chore: pack vulkan windows

* chore: vulkan linux

---------

Co-authored-by: vansangpfiev <[email protected]>

* init python engine documentation

* add docs for python engine

* add docs for python engine

* add docs for python engine

* update: add explanation for CI params input

* update check status python process

* fix: CI build

Co-authored-by: vansangpfiev <[email protected]>

* fix: ignore compute_cap if not present

* fix: correct gpu info

* fix: remove check for toolkit version

---------

Co-authored-by: vansangpfiev <[email protected]>

* chore: clean default local engines

* chore: e2e tests

---------

Co-authored-by: vansangpfiev <[email protected]>

Co-authored-by: vansangpfiev <[email protected]>

* chore: cleanup

* chore: spawn process

---------

Co-authored-by: vansangpfiev <[email protected]>

* devx: add devcontainer

Allow contributors to contribute with less hassle

* devx: increase minimum machine requirement for devcontainer

…/sync-main-to-dev

chore: sync main to dev

chore: correct stop command description

Co-authored-by: vansangpfiev <[email protected]>

…et started

Enhanced Function Calling Guide and the main README, removed warnings at different places where Cortex is stable already, and tweaked the images to showcase current functionality without `tensorrt-llm`.

Co-authored-by: Service Account <[email protected]>

…le (#1918)

Co-authored-by: vansangpfiev <[email protected]>

* feat: QoL improvements for server when running standalone

* fix: detach server child from cli console

* fix: correct gpu info list

* chore: cleanup

---------

Co-authored-by: vansangpfiev <[email protected]>

* feat: AMD hardware API (#1797)

* feat: add amd gpu windows

* chore: remove unused code

* feat: get amd gpus

* fix: clean

* chore: cleanup

* fix: set activate

* fix: build windows

* feat: linux

* fix: add patches

* fix: map cuda gpus

* fix: build

* chore: docs

* fix: build

* chore: clean up

* fix: build

* fix: build

* chore: pack vulkan windows

* chore: vulkan linux

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: add cpu usage (#1868)

Co-authored-by: vansangpfiev <[email protected]>

* fix: PATCH method for Thread and Messages management (#1923)

Co-authored-by: vansangpfiev <[email protected]>

* fix: ignore compute_cap if not present (#1866)

* fix: ignore compute_cap if not present

* fix: correct gpu info

* fix: remove check for toolkit version

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: models.cc: symlinked model deletion shouldn't remove original file (#1918)

Co-authored-by: vansangpfiev <[email protected]>

---------

Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: OHaiiBuzzle <[email protected]>

* fix: add metadata

* fix: add get models by source

* fix: metadata json

* fix: get downloaded models

* fix: add checkedForSyncHubAt to rc

* fix: handle hf download by model id

* fix: update model when download from model sources

* fix: cortexso model download

* feat: AMD hardware API (#1797)

* feat: add amd gpu windows

* chore: remove unused code

* feat: get amd gpus

* fix: clean

* chore: cleanup

* fix: set activate

* fix: build windows

* feat: linux

* fix: add patches

* fix: map cuda gpus

* fix: build

* chore: docs

* fix: build

* chore: clean up

* fix: build

* fix: build

* chore: pack vulkan windows

* chore: vulkan linux

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: add cpu usage (#1868)

Co-authored-by: vansangpfiev <[email protected]>

* fix: handle sub-directory HF

* fix: add author in response for /models/sources GET

* fix: PATCH method for Thread and Messages management (#1923)

Co-authored-by: vansangpfiev <[email protected]>

---------

Co-authored-by: vansangpfiev <[email protected]>

* doc: bring back old build from source instructions

* doc: fix missing ./

* doc: add ./ for windows too

* add cmake prereq

Co-authored-by: sangjanai <[email protected]>

Co-authored-by: sangjanai <[email protected]>

* feat: add inja example

* chore: add README.md

* fix: temp comment out sync

---------

Co-authored-by: sangjanai <[email protected]>

Co-authored-by: vansangpfiev <[email protected]>

* fix: remove all yml files when delete model

* chore: add debug

---------

Co-authored-by: sangjanai <[email protected]>

* feat: AMD hardware API (#1797)

* feat: add amd gpu windows

* chore: remove unused code

* feat: get amd gpus

* fix: clean

* chore: cleanup

* fix: set activate

* fix: build windows

* feat: linux

* fix: add patches

* fix: map cuda gpus

* fix: build

* chore: docs

* fix: build

* chore: clean up

* fix: build

* fix: build

* chore: pack vulkan windows

* chore: vulkan linux

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: add cpu usage (#1868)

Co-authored-by: vansangpfiev <[email protected]>

* fix: PATCH method for Thread and Messages management (#1923)

Co-authored-by: vansangpfiev <[email protected]>

* fix: ignore compute_cap if not present (#1866)

* fix: ignore compute_cap if not present

* fix: correct gpu info

* fix: remove check for toolkit version

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: models.cc: symlinked model deletion shouldn't remove original file (#1918)

Co-authored-by: vansangpfiev <[email protected]>

* fix: correct gpu info list (#1944)

* fix: correct gpu info list

* chore: cleanup

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: gpu: filter out llvmpipe

* fix: add vendor in gpu info (#1952)

Co-authored-by: vansangpfiev <[email protected]>

* fix: correct get server name method (#1953)

Co-authored-by: vansangpfiev <[email protected]>

* fix: map nvidia and vulkan uuid (#1954)

Co-authored-by: vansangpfiev <[email protected]>

* fix: permission issue for default drogon uploads folder (#1870)

Co-authored-by: vansangpfiev <[email protected]>

* chore: change timeout

* fix: make get hardware info function thread-safe (#1956)

Co-authored-by: vansangpfiev <[email protected]>

* fix: cache data for gpu information (#1959)

* fix: wrap vulkan gpu function

* fix: init

* fix: cpu usage

* fix: build windows

* fix: buld macos

---------

Co-authored-by: vansangpfiev <[email protected]>

* fix: handle path with space (#1963)

* fix: unload engine before updating (#1970)

Co-authored-by: sangjanai <[email protected]>

* fix: auto-reload model for remote engine (#1971)

Co-authored-by: sangjanai <[email protected]>

* fix: use updated configuration for remote model when reload (#1972)

Co-authored-by: sangjanai <[email protected]>

* fix: correct engine interface order (#1974)

Co-authored-by: sangjanai <[email protected]>

* fix: improve error handling for remote engine (#1975)

Co-authored-by: sangjanai <[email protected]>

* fix: temporarily remove model setting recommendation (#1977)

Co-authored-by: sangjanai <[email protected]>

---------

Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: OHaiiBuzzle <[email protected]>

Fix: Prevent Out-of-Bounds Reads in GGUF Parser

…sync-dev