Skip to content

Adds bufferSize API to be able to derive memory occupied by a single model - #468

Open
aleroot wants to merge 1 commit into
ml-explore:mainfrom
aleroot:memory_buffer
Open

aleroot wants to merge 1 commit into
ml-explore:mainfrom
aleroot:memory_buffer

Conversation

@aleroot

@aleroot aleroot commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Proposed changes

This is the basic memory for model API based on ml-explore/mlx-c#131 --> ml-explore/mlx#4436

This pull request needs to wait a new version of mlx-c being released and pinned in mlx-c see this PR.

@davidkoski when this will be merged, I have a new memory footprint API ready for mlx-swift-lm, let me know if you think it is useful I can post it now and you can have a look already, otherwise I will wait for the new release.

Checklist

Put an x in the boxes that apply.

  • I have read the CONTRIBUTING document
  • I have run pre-commit run --all-files to format my code / installed pre-commit prior to committing changes
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the necessary documentation (if needed)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant