xdecref is a fair bit slower than decref (especially as it's implemented right
now as a helper function), but I think this will be ok once we get the llvm
jit up and running with refcounting.