perf_counter: Fix swcounter context invariance