Can I connect my circuit to both USB and external voltage?

Yes. There is no problem in connecting the Arduino to both USB and external voltage power supplies. In some cases it is even necessary if you want your circuit to work while you are making changes in the code.