Commit Graph

5 Commits

Author SHA1 Message Date
Rattus
a9bc2d884c MPDynamic: Add support for model defined dtype
If the model defines a dtype that is different to what is in the state
dict, respect that at load time. This is done as part of the casting
process.
2026-01-23 16:54:12 +10:00
Rattus
61dda30171 ruff 2026-01-23 16:52:31 +10:00
Rattus
79b3fe334b misc cleanup 2026-01-23 16:52:31 +10:00
Rattus
15ae09fb19 add missing del on unpin 2026-01-23 16:52:31 +10:00
Rattus
2bf2463ca8 pinned_memory: add python
Add a python for managing pinned memory of the weight/bias module level.
This allocates, pins and attached a tensor to a module for the pin for this
module. It does not set the weight, just allocates a singular ram buffer
for population and bulk DMA transfer.
2026-01-23 16:52:31 +10:00