A hardware accelerator designed for local inference of generative AI models on FPGA or ASIC devices without external CPUs or internet connection.

An upgraded version of the GenAI NPU supporting 4-bit and 5-bit quantization to increase inference speed and reduce memory usage on FPGA devices.