9 Commits

Author	SHA1	Message	Date
Yousef Rafat	12cc6924ac	meta init	2025-11-14 20:10:52 +02:00
Yousef Rafat	7b4c1e8031	async cache revamp ... Added an async loading and offloading of moe layers, having consistent memory with oom errors. Used to give oom error after the third layer with 24 giga bytes gpu, now goes to the end with consistent memory with minimal latency	2025-11-14 09:15:16 +02:00
Yousef Rafat	44346c4251	removed all errors	2025-11-08 19:49:02 +02:00
Yousef Rafat	5056a1f4d4	important fixes	2025-11-06 00:24:49 +02:00
Yousef Rafat	9e9c536c8e	fixes from testing	2025-11-04 23:55:16 +02:00
Yousef Rafat	ca119c44fb	returned kv cache for image generation	2025-11-01 23:06:11 +02:00
Yousef Rafat	10a17dc85d	a bunch of fixes	2025-11-01 16:40:49 +02:00
Yousef Rafat	a2fff60d4c	vectorized implementation of moe/fixes for issues	2025-10-31 23:53:13 +02:00
Yousef Rafat	de43880bdb	Hunyuan Image 3.0	2025-10-31 18:56:20 +02:00