Did you read the sign by the Main Entrance ?
Magical plants will be confiscated at the gate.
You are going to need the bush later.
Drop the bush somewhere on campus before trying to leave.