Guide shows how to profile inference with TorchNeuron on AWS Trainium chips
Hugging Face Blog has published a guide to measuring inference performance on AWS Trainium chips. It brings together torch.profiler, the TorchNeuron tool and the Neuron Explorer viewer, demonstrating the procedure with three implementations of the RMSNorm operation.
If you develop for AWS Trainium chips, this gives you a concrete procedure for comparing CPU time with device time and tracing execution when investigating a slow operation.