Yes and no, you can run linux without installing anything on you harddrive, but often with some form of limitation. You can also install a linux alongside your windows without deleting it, but this will need you do make some spache on your hdd.
The usb stick will get formated during this, so...