perf session: Keep pointers to the vmlinux maps