Let's say I run this straight from a bash command line, where is this information actually being stored?
It goes into the environment for the current shell (stored in the RAM); you can see this by typing
If you quit the shell, then any changes you've made to the environment are lost. If you want changes to persist, then you should add them to the files that your shell will execute on startup (e.g. one of