Your symptoms may return when you stop using Ativan after using it over a long period of time. You may also have seizures or withdrawal symptoms when you stop using Ativan. Withdrawal symptoms may include tremor, sweating, muscle cramps, stomach pain, vomiting, unusual thoughts or behavior, and seizure (convulsions).