You can – it just isn't very comfortable. You have to choose between the hassle of taking your elastics out and putting new ones in, and eating with them in, which can make an elastic snap unexpectedly.
This answer is for general information. Your own case needs an examination by an orthodontist.