OpenMP and OmpSS-2 parallelisation of LLMs
Monteiro, Erwin
LLM inference on multicore CPUs is increasingly relevant for edge, cost-sensitive, and hybrid CPU-GPU deployments, yet a systematic comparison of shared-memory parallelisation frameworks applied directly to transformer inference kernels remains absent from the literature. This thesis is specifically focused on parallel...
- Universitat Politècnica de Catalunya
- Spain
- English