I’m getting panic attacks to start new job should i iust not go?

It's perfectly reasonable to feel a little anxious when you are about to embark on something new.
But new jobs are a process.
You start day 1 knowing next to nothing, having to follow somebody around who's job it is to show you the ropes, then they let you go to see how you get on.

You'll make errors and genuine mistakes. They expect that.
It's how you deal with this that determines what happens afterwards.
And unless you're working with people where mistakes can have serious repercussions, it's likely to be just normal errors they'll have seen a hundred times before.

It depends. In your experience with jobs before, has the anxiety lessened over time or has it stayed the same or increased?

I had constant anxiety due to starting a job and once I noticed I can't handle the job demands not even get there on time cause of my panic attacks and dissociative states, they told me I was fired and that I should seek professional help.

It was my realization that I can't handle a job.

If I understand it correctly. For a normal person the nervousity and anxiety fades over time as they get more familiar and confident with their work environment and tasks.

I have never experienced it. For me it's like it's the first day every day even in a job I've had for months. The anxiety was just at roof top all the time and even on the weekends, on my days off, I had anxiety attacks over going back to work on Monday.