Skip to content

MPS support#5

Merged
p-e-w merged 3 commits intop-e-w:masterfrom
txgsync:master
Nov 17, 2025
Merged

MPS support#5
p-e-w merged 3 commits intop-e-w:masterfrom
txgsync:master

Conversation

@mbarnson
Copy link
Contributor

Added basic MPS (Apple Silicon) support. Tested on Qwen2.5-0.5B. Seems to work fine, abliterated the model in 18 minutes on M4 Max 128GB.

@p-e-w p-e-w merged commit 09730ba into p-e-w:master Nov 17, 2025
@p-e-w
Copy link
Owner

p-e-w commented Nov 17, 2025

Thanks!

@QueryType
Copy link

Thanks! What is the memory requirement for such a task? I have an M4 Pro, Mac Mini, 64GB.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants