Semiconductor News & Analysis Feed

This article explores how host offloading techniques can alleviate high-bandwidth memory (HBM) bottlenecks in large language model (LLM) training using the JAX framework. As model size, sequence length, and batch size increase, GPU memory becomes a critical constraint. The study highlights NVIDIA's

Apple announced a price increase for its Mac and iPad products on Thursday, attributing the rise to a shortage of memory chips driven by the artificial intelligence boom. The Cupertino-based tech giant described the surge in demand as an 'unprecedented challenge' for the consumer electronics industr

NVIDIA introduces NVFP4 (NVIDIA Float Point 4) technology for large language model (LLM) pretraining, aiming to significantly enhance training efficiency while maintaining model accuracy. Utilizing sub-byte precision in JAX and MaxText frameworks, NVFP4 enables 4-bit mixed-precision pretraining on N