How To Remove Quest Items From Inventory In Oblivion? (PS3)?

as far as i can remember you cant throw quest items away, but i think you can put them in a locker or something like that so you dont have to carry them with you all the time.