Seriously considering quitting

And just living off my savings and going to school full time. Im worth over a quarter million dollars, I shouldn’t have to be dealing with bullshit nonstop and exhausting myself. I could do it, but the money would only last a few years which is why Im still working despite all my savings. Should I do it or not?